-- Logs begin at Thu 2022-08-04 01:15:32 UTC, end at Thu 2022-08-04 02:51:47 UTC. -- Aug 04 02:21:43.575820 dv-cinder-733062-32-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 02:21:43.584360 dv-cinder-733062-32-smb devstack@keystone.service[80469]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 02:21:43 2022] *** Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: nodename: dv-cinder-733062-32-smb Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: machine: x86_64 Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: clock source: unix Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: pcre jit disabled Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: detected number of CPU cores: 4 Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: current working directory: / Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: detected binary path: /usr/bin/uwsgi-core Aug 04 02:21:43.586394 dv-cinder-733062-32-smb devstack@keystone.service[80469]: your processes number limit is 47680 Aug 04 02:21:43.586973 dv-cinder-733062-32-smb devstack@keystone.service[80469]: your memory page size is 4096 bytes Aug 04 02:21:43.586973 dv-cinder-733062-32-smb devstack@keystone.service[80469]: detected max file descriptor number: 2048 Aug 04 02:21:43.586973 dv-cinder-733062-32-smb devstack@keystone.service[80469]: lock engine: pthread robust mutexes Aug 04 02:21:43.586973 dv-cinder-733062-32-smb devstack@keystone.service[80469]: thunder lock: enabled Aug 04 02:21:43.586973 dv-cinder-733062-32-smb devstack@keystone.service[80469]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 02:21:43.586973 dv-cinder-733062-32-smb devstack@keystone.service[80469]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 02:21:43.626145 dv-cinder-733062-32-smb devstack@keystone.service[80469]: Python main interpreter initialized at 0x55cbe7a179c0 Aug 04 02:21:43.626145 dv-cinder-733062-32-smb devstack@keystone.service[80469]: python threads support enabled Aug 04 02:21:43.626145 dv-cinder-733062-32-smb devstack@keystone.service[80469]: your server socket listen backlog is limited to 100 connections Aug 04 02:21:43.626145 dv-cinder-733062-32-smb devstack@keystone.service[80469]: your mercy for graceful operations on workers is 90 seconds Aug 04 02:21:43.626487 dv-cinder-733062-32-smb devstack@keystone.service[80469]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 02:21:43.626563 dv-cinder-733062-32-smb devstack@keystone.service[80469]: *** Operational MODE: preforking *** Aug 04 02:21:43.626810 dv-cinder-733062-32-smb devstack@keystone.service[80469]: *** uWSGI is running in multiple interpreter mode *** Aug 04 02:21:43.626810 dv-cinder-733062-32-smb devstack@keystone.service[80469]: spawned uWSGI master process (pid: 80469) Aug 04 02:21:43.627005 dv-cinder-733062-32-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 04 02:21:43.629544 dv-cinder-733062-32-smb devstack@keystone.service[80469]: spawned uWSGI worker 1 (pid: 80480, cores: 1) Aug 04 02:21:43.629544 dv-cinder-733062-32-smb devstack@keystone.service[80469]: spawned uWSGI worker 2 (pid: 80481, cores: 1) Aug 04 02:21:43.629544 dv-cinder-733062-32-smb devstack@keystone.service[80469]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 02:21:49.118208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:21:49.118208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: from cryptography.utils import int_from_bytes Aug 04 02:21:49.119003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:21:49.119003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: from cryptography.utils import int_from_bytes Aug 04 02:21:49.128387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:21:49.128387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: from cryptography.utils import int_from_bytes Aug 04 02:21:49.128857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 02:21:49.128857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: from cryptography.utils import int_from_bytes Aug 04 02:21:49.169404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:21:49.169605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:21:49.169799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] command line args: [] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:21:49.170075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:21:49.170256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ================================================================================ {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:21:49.170510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] admin_token = **** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.170758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] config_dir = [] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.170947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.171150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] config_source = [] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.171313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] debug = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.171514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.172007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.172105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.172305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.172555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.172787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] list_limit = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.172968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] log_config_append = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.173153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.173356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] log_dir = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.173534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] log_file = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.173778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.174026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.174274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.174523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.174704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.174881 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.175126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.175375 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.175525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 02:21:49.175617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.175726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 02:21:49.175851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.175976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] command line args: [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 02:21:49.176085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.176227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 02:21:49.176343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.176487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ================================================================================ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 02:21:49.176596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.176701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] admin_token = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.176805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.176946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] config_dir = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.176946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.177160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.177300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] config_source = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.177300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] debug = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.177548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.177711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.177711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] publish_errors = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.177922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.177922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_config_append = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.178901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] standard_threads = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_dir = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_file = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] use_journal = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.179997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] use_json = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.180153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] use_stderr = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.180235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.180315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.180398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] use_syslog = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.180477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.180552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.180708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.180791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.180948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.181038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.181178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.181262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.181437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.181570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.181688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.181801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.181914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.182610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.182909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.183088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.183304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.183430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.183574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.183697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.183826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.184049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.184172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.184294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] publish_errors = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.184415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.184537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.184657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.184772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.184885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.184998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.185119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.185234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.185366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.185483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.185596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.185720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] standard_threads = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.185842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.185958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.186071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.186190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.186190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.186409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.186531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_journal = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.186646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.186759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_json = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.186759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_stderr = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.186971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.187090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_syslog = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.187215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.187330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 02:21:49.187449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.187569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.187683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.187796 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.187920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.188043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.188157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.188277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.188397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.188511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.188699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.188876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.188991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.189113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.189234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.189376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.189508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.189624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.189737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.189850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.189974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.190096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.190218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.190339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.190453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.190573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.190686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.190806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.190928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.191042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.191162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.191276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.191396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.191517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.191642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.191758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.191871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.191984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.192096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.192217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.192332 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.192452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.192565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.192678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.192797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.192922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.193042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.193157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.193271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.193399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.193514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.193644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.193760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.193874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.193986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.194099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.194211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.194399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.194522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.194642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.194762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.194877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.194990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.195111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.195226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.195340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.195453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.195566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.195678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.195799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.195914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.196033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.196147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.196260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.196373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.196494 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.196609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.196722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.196835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.196957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.197072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.197177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.197278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.197409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.197508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.197625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.197769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.197879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.197977 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.198072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.198168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.198284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.198389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.198511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.198511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.198727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.198843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.198957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.199072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.199199 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.199323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.199439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.199563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.199679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.199792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.199909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.200032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.200154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.200270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.200385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.200506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.200625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.200748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.200864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.200968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.201087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.201203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.201318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.201564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.201690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.201807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.201922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.202026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.202138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.202261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.202368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.202489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.202605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.202720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.202835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.202957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.203073 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.203188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.203301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.203422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.203537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.203659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.203783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.203898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.204013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.204128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.204242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.204365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.204575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.204698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.204816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.204931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.205046 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.205169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.205297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.205476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.205591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.205705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.205821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.206017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.206135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.206257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.206372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.206486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.206601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.206723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.206854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.206982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.207098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] auth.external = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.207213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.207327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.207448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.207569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.207697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.207813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.207929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.208043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] auth.password = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.208224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.208353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] auth.token = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.208470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.208591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.208712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.208828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.208943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.209066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.209182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.209297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.209429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.209429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.209644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.209770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.209886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.210005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.210119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.210233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.210376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] credential.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.210502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.210620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.210743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.210868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.210991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.211108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.211223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.211338 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.211461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.211578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.211701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.211825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.211940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.212055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.212179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.212296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.212412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.external = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.212526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.212642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.212757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.212880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.212998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.213114 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.213229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.213387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.password = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.213505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.213633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.token = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.213751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.213866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.213866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.214090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.214213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.214337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] federation.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.214453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.214568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.214683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.214805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.214923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.215045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.215162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.215279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.215393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.215509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.215624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.215747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.215909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.216028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.216144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.216260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.216375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.216499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.216615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.216730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.216845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.216960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.217075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.217198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.217315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.217447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.217562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.217677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.217793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.217920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.218037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.218151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.218274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.218392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.218507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.218631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.218748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.218863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.218979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.219112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.219230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.219361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.219480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.219601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.219726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.219843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.219843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.220135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.220135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.220356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.220472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.220594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.220719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.220836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.220951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.221066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.221181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.221296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.221459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.221581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.221696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.221811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.221926 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.222040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.222163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.222280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.222395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.222516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.222633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.222748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.222871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.222987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.223102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.223218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.223332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.223447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.223570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.223687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.223838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.223957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.224072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.224187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.224315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.224433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.224548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.224671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.224787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.224902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.225026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.225142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.225257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.225397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.225516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.225632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.225756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.225873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.226019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.226170 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.226288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.226403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.226527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.226644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.226761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.226875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.226990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.227105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.227228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.227345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.227460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.227575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.227697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.227815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.227938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.228056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.228171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.228286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.228400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.228515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.228639 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.228756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.229396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.229517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.229633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.229748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.229877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.230000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.230115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.230236 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.230353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.230468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.230592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.230714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.230831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.230947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.231062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.231062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.231287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.231404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.231519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.231624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.231738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.231861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.231978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.232094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.232209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.232324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.232439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.232562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.232678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.232793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.232908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.233023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.233139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.233263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.233412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.233538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.233655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.233770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.233885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.234009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.234127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.234242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.234363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.234480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.234595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.234718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.234835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.234950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.235065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.235188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.235304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.235427 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.235544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.235660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.235775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.235890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.236005 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.236128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.236128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.236347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.236462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.236577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.236692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.236815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.236933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.237048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.237163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.237279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.237432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.237560 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.237678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.237794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.237909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.238024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.238139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.238262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.238380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.238495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.238609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.238724 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.238881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.239008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] resource.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.239125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.239240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.239357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.239472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.239587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.239710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.239826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.239945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.240067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.240253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.240375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.240500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.240617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.240770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.240888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.241003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.241118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.241242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.241373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.241492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] role.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.241607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.241726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] role.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.241874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.242009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.242127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.242242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.242357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.242472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.242587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.242711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.242833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.242949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.243064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.243179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.243295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.243483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.243603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.243717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.243832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.243947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.244062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.244186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.244303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.244418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.244640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.245263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.245432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.245552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.245669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.245785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.245900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.245900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.246132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.246278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.246402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.246518 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] role.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.246633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.246750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] role.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.246873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.246990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.247104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.247219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.247334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.247448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.247572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.247688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.247805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.247920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.248036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.248151 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.248274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.248391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.248505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.248620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.248735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.248851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.248974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.249098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.249214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.249347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.249465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.249580 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.249708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.249826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.249942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.250060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.250175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.250175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.250399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.250516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] token.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.250631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.250746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.250862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.250977 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.251101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.251218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.251334 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.251449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.251564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.251687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.251803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.251919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.252034 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.252149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.252263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.252390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.252507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.252622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.252737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.252737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.252954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.253079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.253195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.253310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.253475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.253475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.253709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.253709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.253941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.253941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.254164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.254164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.254380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.254503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.254620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.254735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.254849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.connection = **** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.254973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.255098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.255215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.255330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.255453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.255570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.255684 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.255799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.255914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.256028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.256153 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.256269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.256384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.256499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.256613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.256727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.256850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.256967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.257081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.257196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.257311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.257445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.257573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.257690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.257804 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.257918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.258033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.258147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.258271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.258387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.258502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.258617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.258617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.258832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.258954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80480) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:21:49.259309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.259309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.260264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.260264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.260264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.260264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.260264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.260264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.260264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.260264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.260264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 02:21:49.261201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 02:21:49.285836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.286066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.286292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.288353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.288582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.288804 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.295229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.297556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.325314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.325471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.325547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.325710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.379394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.380241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.430257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.430381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.430488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.430573 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.495467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.495690 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.495886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.495970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.496112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.496211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.496325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.496407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.496534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.496618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.496749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.496965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.519334 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.519556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.519785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.519872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.519995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.520078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.520204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.520285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.520411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.520502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.520618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.520699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.520850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.521064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.532411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.532936 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.545655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.545880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.546100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.546272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.546370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.546510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.546593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.546721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.546802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.546932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.547015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.547148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.547357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.547571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80480) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 02:21:49.564972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.565179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 02:21:49.565548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.565634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.565746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 02:21:49.565829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 02:21:49.566007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.566138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.566260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.566342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 02:21:49.566511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.566602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.566759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.566839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.567090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.567343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.576458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.576734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.577000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.577084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.577276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.577388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.577608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.577886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.584192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.584791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.589428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.589702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.589977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.590057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.590249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.590330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.590521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.590603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.590772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.590856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.591032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.591123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.591296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.591379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.591559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.591640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.591824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.591913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.592082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.592163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.592417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.592684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.615402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.616218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.616870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.617146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.617808 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.618087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.621781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.622058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.622336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.622774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.623056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.623339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.628889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.629164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.630078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.630319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.633236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.633542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.633819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.634101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.634392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.634486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.634688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.634770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.634961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.635084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.635253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.635348 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.635593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.635885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.636163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.636438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.651542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.651813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.653046 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.653340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.655739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.657583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.659209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.659497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.660732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.661030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.663872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.665493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.667582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.669590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.670737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.671041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.671330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.671614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.671891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.672162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.672741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.673052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.673349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.673649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.673929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.674207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.688030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.688310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.688573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.688840 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.690318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.690607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.690873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.691135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.695658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.697190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.697485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.698109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.699671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.699949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.700300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.700574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.700864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.701140 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.701441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.702814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.703095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.703392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.703691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.703994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.712767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.713040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.713846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.714130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.714400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.714672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.714937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.716000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.716279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.716559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.716845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.717124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.717433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.717713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.730940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.733915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.734001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.736949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.737038 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.739465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.739915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.740970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.741247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.741550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.742464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.743971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.744249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.744569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.747961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.749575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.751058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.752478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.752673 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.752769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.753025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.753293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.755633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.755929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.756210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.756482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.761439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.761730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.762006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.764583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.764874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.765154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.768830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.769105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.769403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.769674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.769939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.770203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.770468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.770744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.771131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.771395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.771658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.771921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.772068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80480) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 02:21:49.772180 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.772347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.772428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.772623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.772892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.773160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.773457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.773729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.774002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.774395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.774666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.774939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.775205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.775467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.776242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80480) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 02:21:49.806767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbe7a179c0 pid: 80481 (default app) Aug 04 02:21:49.810082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a90ae-b322-419e-ac62-c2718b843e5e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:21:49.810370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a90ae-b322-419e-ac62-c2718b843e5e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:21:49.810643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a90ae-b322-419e-ac62-c2718b843e5e None None] PATH_INFO: `/v3` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:21:49.811715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbe7a179c0 pid: 80480 (default app) Aug 04 02:21:49.814918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Thu Aug 4 02:21:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:21:57.373015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93698cf8-31e5-40b0-a627-5fed7ac5223a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:21:57.373593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93698cf8-31e5-40b0-a627-5fed7ac5223a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:21:57.373593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93698cf8-31e5-40b0-a627-5fed7ac5223a None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:21:57.378081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:21:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:21:57.383299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:21:57.383726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:21:57.383856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:21:57.453745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: INFO dbcounter [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] Registered counter for database keystone Aug 04 02:21:57.472622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG oslo_db.sqlalchemy.engines [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:21:57.479275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writer thread running {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:21:57.654956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG passlib.handlers.bcrypt [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80481) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 02:21:57.655300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG passlib.handlers.bcrypt [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80481) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 02:21:57.709566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:21:57.711207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:21:57.840363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:21:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 02:21:57.982135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93698cf8-31e5-40b0-a627-5fed7ac5223a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:21:58.049813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: INFO dbcounter [None req-93698cf8-31e5-40b0-a627-5fed7ac5223a None None] Registered counter for database keystone Aug 04 02:21:58.070369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG oslo_db.sqlalchemy.engines [None req-93698cf8-31e5-40b0-a627-5fed7ac5223a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80480) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 02:21:58.076921 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writer thread running {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 02:21:58.192243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93698cf8-31e5-40b0-a627-5fed7ac5223a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:21:58.196444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c410b18-c7e6-4bb3-a267-b73821b0b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:21:58.197077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410b18-c7e6-4bb3-a267-b73821b0b595 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:21:58.197904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410b18-c7e6-4bb3-a267-b73821b0b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:21:58.198176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410b18-c7e6-4bb3-a267-b73821b0b595 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:21:58.206171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c410b18-c7e6-4bb3-a267-b73821b0b595 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:21:58.257201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3c410b18-c7e6-4bb3-a267-b73821b0b595 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 02:21:58.257505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c410b18-c7e6-4bb3-a267-b73821b0b595 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:21:58.267463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1324 bytes} [Thu Aug 4 02:21:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 02:21:58.273389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:21:58.288388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d5cdc-47ce-4900-9a9a-169120fac30f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:21:58.292761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb702d9c-4c2c-42bb-ac21-8b5c0435374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:21:58.293907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb702d9c-4c2c-42bb-ac21-8b5c0435374f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:21:58.294189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb702d9c-4c2c-42bb-ac21-8b5c0435374f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:21:58.294461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb702d9c-4c2c-42bb-ac21-8b5c0435374f admin admin] PATH_INFO: `/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:21:58.295933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb702d9c-4c2c-42bb-ac21-8b5c0435374f admin admin] RBAC: Authorizing `identity:get_project(project_id=bfeabf1f8bfc459e9c6e85a4b8e64db7)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:21:58.345887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eb702d9c-4c2c-42bb-ac21-8b5c0435374f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 02:21:58.346222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb702d9c-4c2c-42bb-ac21-8b5c0435374f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:21:58.350781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 3/5] 10.222.0.69 () {56 vars in 1207 bytes} [Thu Aug 4 02:21:58 2022] GET /identity/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:00.306952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e6ff-2cba-405f-a50c-bfc3ea104f5c None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:00.307490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e6ff-2cba-405f-a50c-bfc3ea104f5c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:00.307490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e6ff-2cba-405f-a50c-bfc3ea104f5c None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:00.311615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 3/6] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:00.316871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667e79-8ab9-4c73-bd8a-1b6ea9ec1f12 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:00.317272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667e79-8ab9-4c73-bd8a-1b6ea9ec1f12 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:00.317460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667e79-8ab9-4c73-bd8a-1b6ea9ec1f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:00.337553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-de667e79-8ab9-4c73-bd8a-1b6ea9ec1f12 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:00.339700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-de667e79-8ab9-4c73-bd8a-1b6ea9ec1f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:00.347545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 02:22:00.368743 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119e6ff-2cba-405f-a50c-bfc3ea104f5c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:00.380467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119e6ff-2cba-405f-a50c-bfc3ea104f5c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:00.384574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9a9d1-6245-4dce-96ec-15d3f87a1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:00.385716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9a9d1-6245-4dce-96ec-15d3f87a1c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:00.385997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9a9d1-6245-4dce-96ec-15d3f87a1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:00.386268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9a9d1-6245-4dce-96ec-15d3f87a1c61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:00.393865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9a9d1-6245-4dce-96ec-15d3f87a1c61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:00.395616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9a9d1-6245-4dce-96ec-15d3f87a1c61 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:00.404984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1324 bytes} [Thu Aug 4 02:22:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:22:00.410355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667e79-8ab9-4c73-bd8a-1b6ea9ec1f12 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:00.419184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667e79-8ab9-4c73-bd8a-1b6ea9ec1f12 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:00.423430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701053e-dba2-4538-8103-b9c65d166c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:00.424047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701053e-dba2-4538-8103-b9c65d166c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:00.424322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701053e-dba2-4538-8103-b9c65d166c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:00.424595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701053e-dba2-4538-8103-b9c65d166c8b admin admin] PATH_INFO: `/v3/users/525c51ec9f124dbfa5960c298384d18f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:00.425993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701053e-dba2-4538-8103-b9c65d166c8b admin admin] RBAC: Authorizing `identity:get_user(user_id=525c51ec9f124dbfa5960c298384d18f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:00.427783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701053e-dba2-4538-8103-b9c65d166c8b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:00.429295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 5/9] 10.222.0.69 () {56 vars in 1198 bytes} [Thu Aug 4 02:22:00 2022] GET /identity/v3/users/525c51ec9f124dbfa5960c298384d18f => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:02.468571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd238e8-c854-414f-a7e9-19d32be1f0b2 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:02.469115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd238e8-c854-414f-a7e9-19d32be1f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:02.469115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd238e8-c854-414f-a7e9-19d32be1f0b2 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:02.470482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:02.475464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a93b80-a30e-4367-b9f0-aeb470f3535f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:02.475836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a93b80-a30e-4367-b9f0-aeb470f3535f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:02.476014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a93b80-a30e-4367-b9f0-aeb470f3535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:02.481998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd4833-c068-4b1a-880a-733f3d3fabe0 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:02.482287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd4833-c068-4b1a-880a-733f3d3fabe0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:02.482563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd4833-c068-4b1a-880a-733f3d3fabe0 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:02.483836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 6/11] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:22:02.488945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02a054-4790-463e-a4e9-874af6d6f362 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:02.489233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02a054-4790-463e-a4e9-874af6d6f362 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:02.489548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02a054-4790-463e-a4e9-874af6d6f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:02.495695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-39a93b80-a30e-4367-b9f0-aeb470f3535f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:02.496882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-39a93b80-a30e-4367-b9f0-aeb470f3535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:02.531611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG passlib.handlers.bcrypt [None req-2b02a054-4790-463e-a4e9-874af6d6f362 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80480) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 02:22:02.532296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG passlib.handlers.bcrypt [None req-2b02a054-4790-463e-a4e9-874af6d6f362 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80480) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 02:22:02.577955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:02.578242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2b02a054-4790-463e-a4e9-874af6d6f362 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:02.579865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2b02a054-4790-463e-a4e9-874af6d6f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:02.600748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a93b80-a30e-4367-b9f0-aeb470f3535f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:02.625105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:02.680404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:02.702142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02a054-4790-463e-a4e9-874af6d6f362 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:02.704040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a93b80-a30e-4367-b9f0-aeb470f3535f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:02.738222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6ebb-48d9-4e25-af49-11cac5ebbf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:02.738795 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6ebb-48d9-4e25-af49-11cac5ebbf34 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:02.739087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6ebb-48d9-4e25-af49-11cac5ebbf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:02.739366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6ebb-48d9-4e25-af49-11cac5ebbf34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:02.751235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e6ebb-48d9-4e25-af49-11cac5ebbf34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-914e6ebb-48d9-4e25-af49-11cac5ebbf34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:02.760156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:02.761213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:02.762432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 7/14] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:02.767253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6ebb-48d9-4e25-af49-11cac5ebbf34 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:02.804097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02a054-4790-463e-a4e9-874af6d6f362 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:02.806476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:02.842455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af6aab-b064-47be-8fcd-75ee11e1e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:02.843323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6aab-b064-47be-8fcd-75ee11e1e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:02.843607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6aab-b064-47be-8fcd-75ee11e1e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:02.843885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af6aab-b064-47be-8fcd-75ee11e1e1e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:02.848600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:02.866136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6ebb-48d9-4e25-af49-11cac5ebbf34 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:02.900999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d717-b40d-4656-aeb6-9ae2c14edead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:02.901644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d717-b40d-4656-aeb6-9ae2c14edead None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:02.901922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d717-b40d-4656-aeb6-9ae2c14edead None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:02.902199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d717-b40d-4656-aeb6-9ae2c14edead None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:02.902910 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24d717-b40d-4656-aeb6-9ae2c14edead None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:02.903208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24d717-b40d-4656-aeb6-9ae2c14edead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:02.904587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24d717-b40d-4656-aeb6-9ae2c14edead None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:02.910071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af6aab-b064-47be-8fcd-75ee11e1e1e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:02.911569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af6aab-b064-47be-8fcd-75ee11e1e1e7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:02.916790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 8/15] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:02.922611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d717-b40d-4656-aeb6-9ae2c14edead None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:03.011150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 8/16] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 02:22:03.016856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af6aab-b064-47be-8fcd-75ee11e1e1e7 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:03.019505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:03.023798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d717-b40d-4656-aeb6-9ae2c14edead None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:03.121707 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af6aab-b064-47be-8fcd-75ee11e1e1e7 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:03.157552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b2c92-fe04-4129-bad3-cfdc8d589051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:03.158478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b2c92-fe04-4129-bad3-cfdc8d589051 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:03.158708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b2c92-fe04-4129-bad3-cfdc8d589051 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:03.158978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b2c92-fe04-4129-bad3-cfdc8d589051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:03.163307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45a725-3afe-4de2-9f14-a6b9610973cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:03.163994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45a725-3afe-4de2-9f14-a6b9610973cd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:03.164274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45a725-3afe-4de2-9f14-a6b9610973cd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:03.164545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45a725-3afe-4de2-9f14-a6b9610973cd None admin] PATH_INFO: `/v3/users/525c51ec9f124dbfa5960c298384d18f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:03.165715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45a725-3afe-4de2-9f14-a6b9610973cd None admin] RBAC: Authorizing `identity:get_user(user_id=525c51ec9f124dbfa5960c298384d18f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:03.167199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45a725-3afe-4de2-9f14-a6b9610973cd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:03.168775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 9/17] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:02 2022] GET /identity/v3/users/525c51ec9f124dbfa5960c298384d18f => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:03.174318 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45a725-3afe-4de2-9f14-a6b9610973cd None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:03.176979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b2c92-fe04-4129-bad3-cfdc8d589051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:03.178466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b2c92-fe04-4129-bad3-cfdc8d589051 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:03.189147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-2d2b2c92-fe04-4129-bad3-cfdc8d589051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:03.196791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:03.198244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:03.199261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:03.199261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:03.199261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:03.199261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:03.199261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 9/18] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:03.204272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b2c92-fe04-4129-bad3-cfdc8d589051 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:03.259125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:03.279564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45a725-3afe-4de2-9f14-a6b9610973cd None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:03.304639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b2c92-fe04-4129-bad3-cfdc8d589051 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:03.319457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f510c-aa8c-4a52-9ee3-863d72ed7a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:03.320098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f510c-aa8c-4a52-9ee3-863d72ed7a9e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:03.320379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f510c-aa8c-4a52-9ee3-863d72ed7a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:03.320659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f510c-aa8c-4a52-9ee3-863d72ed7a9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:03.321835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f510c-aa8c-4a52-9ee3-863d72ed7a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:03.323902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f510c-aa8c-4a52-9ee3-863d72ed7a9e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:03.325536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 10/19] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:03.331357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f510c-aa8c-4a52-9ee3-863d72ed7a9e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:03.337827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033423b2-3fea-4c6d-a89e-7baa4c52bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:03.338445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033423b2-3fea-4c6d-a89e-7baa4c52bafe None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:03.338727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033423b2-3fea-4c6d-a89e-7baa4c52bafe None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:03.339002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033423b2-3fea-4c6d-a89e-7baa4c52bafe None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:03.339701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033423b2-3fea-4c6d-a89e-7baa4c52bafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:03.340001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033423b2-3fea-4c6d-a89e-7baa4c52bafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:03.341413 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033423b2-3fea-4c6d-a89e-7baa4c52bafe None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:03.359466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 10/20] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:03.422508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:03.443997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f510c-aa8c-4a52-9ee3-863d72ed7a9e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:03.478803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366144-e59c-4c1f-acbf-5b2a051d9075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:03.479455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366144-e59c-4c1f-acbf-5b2a051d9075 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:03.479694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366144-e59c-4c1f-acbf-5b2a051d9075 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:03.479966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366144-e59c-4c1f-acbf-5b2a051d9075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:03.480764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366144-e59c-4c1f-acbf-5b2a051d9075 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.domain.id=default, user.id=525c51ec9f124dbfa5960c298384d18f) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:03.481070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366144-e59c-4c1f-acbf-5b2a051d9075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:03.482568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366144-e59c-4c1f-acbf-5b2a051d9075 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:03.489976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 11/21] 10.222.0.69 () {56 vars in 1322 bytes} [Thu Aug 4 02:22:03 2022] GET /identity/v3/role_assignments?user.id=525c51ec9f124dbfa5960c298384d18f&scope.domain.id=default&role.id=999cac3070e64b82b981258349005963 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:05.834559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a860c6-426d-4ba9-ad7a-74ed8bcca811 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:05.834559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a860c6-426d-4ba9-ad7a-74ed8bcca811 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:05.834559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a860c6-426d-4ba9-ad7a-74ed8bcca811 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:05.834559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 11/22] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:05.836790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aca6e-859a-4101-8c4e-0e11fb28db34 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:05.837598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aca6e-859a-4101-8c4e-0e11fb28db34 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:05.838047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aca6e-859a-4101-8c4e-0e11fb28db34 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:05.839534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 12/23] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:05.844751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ff093-671d-4aa0-84d8-cfd79bfab4d6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:05.846177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5dcce-89c8-443b-9965-e21bd382571a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:05.846664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5dcce-89c8-443b-9965-e21bd382571a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:05.847154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ff093-671d-4aa0-84d8-cfd79bfab4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:05.847642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5dcce-89c8-443b-9965-e21bd382571a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:05.848120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ff093-671d-4aa0-84d8-cfd79bfab4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:05.878270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bdb5dcce-89c8-443b-9965-e21bd382571a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:05.879808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bdb5dcce-89c8-443b-9965-e21bd382571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:05.885349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-229ff093-671d-4aa0-84d8-cfd79bfab4d6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:05.885349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-229ff093-671d-4aa0-84d8-cfd79bfab4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:05.963907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 13/24] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:05.965609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47010d-de01-4e20-b955-8b6c722ad2d2 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:05.966095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47010d-de01-4e20-b955-8b6c722ad2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:05.966564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47010d-de01-4e20-b955-8b6c722ad2d2 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:05.968253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 14/25] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:05.974274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9b20-8489-4737-a217-93dabdaa003c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:05.974808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9b20-8489-4737-a217-93dabdaa003c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:05.975278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f9b20-8489-4737-a217-93dabdaa003c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:06.001139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-075f9b20-8489-4737-a217-93dabdaa003c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:06.002367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-075f9b20-8489-4737-a217-93dabdaa003c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:06.006473 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 12/26] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:06.007291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ff093-671d-4aa0-84d8-cfd79bfab4d6 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:06.095314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:06.136726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 15/27] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:06.137602 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f9b20-8489-4737-a217-93dabdaa003c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:06.144512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:06.202592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ff093-671d-4aa0-84d8-cfd79bfab4d6 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:06.277842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01951a69-383c-4a0e-add9-2c280a3ab40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:06.278824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01951a69-383c-4a0e-add9-2c280a3ab40a None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:06.279325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01951a69-383c-4a0e-add9-2c280a3ab40a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:06.279797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01951a69-383c-4a0e-add9-2c280a3ab40a None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:06.280708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01951a69-383c-4a0e-add9-2c280a3ab40a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:06.282614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01951a69-383c-4a0e-add9-2c280a3ab40a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:06.302160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f9b20-8489-4737-a217-93dabdaa003c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:06.346590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc982b4-4994-43ad-80e2-1a63312e594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:06.347342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc982b4-4994-43ad-80e2-1a63312e594a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:06.347726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc982b4-4994-43ad-80e2-1a63312e594a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:06.348090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc982b4-4994-43ad-80e2-1a63312e594a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:06.361252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc982b4-4994-43ad-80e2-1a63312e594a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ecc982b4-4994-43ad-80e2-1a63312e594a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:06.366792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:06.367663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:06.368401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 16/28] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:06.369071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc982b4-4994-43ad-80e2-1a63312e594a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:06.442806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:06.484156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc982b4-4994-43ad-80e2-1a63312e594a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:06.520095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5f7a6-1263-4c2b-9355-be43151194aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:06.521043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5f7a6-1263-4c2b-9355-be43151194aa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:06.521493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5f7a6-1263-4c2b-9355-be43151194aa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:06.521923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5f7a6-1263-4c2b-9355-be43151194aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:06.523324 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 13/29] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Aug 4 02:22:06 2022] POST /identity/v3/roles => generated 219 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:06.525014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5af77-0462-411a-9aea-587ed664776a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:06.525552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5af77-0462-411a-9aea-587ed664776a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:06.526022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5af77-0462-411a-9aea-587ed664776a None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:06.527658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 14/30] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:06.528640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5af77-0462-411a-9aea-587ed664776a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:06.540214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5f7a6-1263-4c2b-9355-be43151194aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:06.542363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5f7a6-1263-4c2b-9355-be43151194aa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c2b5f7a6-1263-4c2b-9355-be43151194aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:22:06.565370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:06.566217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:06.567105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:22:06.567105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:22:06.567105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:22:06.567105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:06.567105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 17/31] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:06.567795 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3cf7-e734-412f-a219-ec871ff3282a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:06.568240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3cf7-e734-412f-a219-ec871ff3282a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:06.568656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3cf7-e734-412f-a219-ec871ff3282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:06.594646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-181c3cf7-e734-412f-a219-ec871ff3282a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:06.595939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-181c3cf7-e734-412f-a219-ec871ff3282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:06.677834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 18/32] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:06.678713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c3cf7-e734-412f-a219-ec871ff3282a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:06.690344 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5af77-0462-411a-9aea-587ed664776a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:06.699440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:06.763952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50a06f-ede1-4c73-b011-f1896e6eae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:06.764603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50a06f-ede1-4c73-b011-f1896e6eae96 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:06.764883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50a06f-ede1-4c73-b011-f1896e6eae96 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:06.765161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50a06f-ede1-4c73-b011-f1896e6eae96 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:06.765921 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50a06f-ede1-4c73-b011-f1896e6eae96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:06.766221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50a06f-ede1-4c73-b011-f1896e6eae96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:06.775053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50a06f-ede1-4c73-b011-f1896e6eae96 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:06.792996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:06.796784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 15/33] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:06.797899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50a06f-ede1-4c73-b011-f1896e6eae96 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:06.864509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c3cf7-e734-412f-a219-ec871ff3282a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:06.908279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5648d8-467f-4aae-b3f0-59261dea964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:06.909284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5648d8-467f-4aae-b3f0-59261dea964d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:06.909818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5648d8-467f-4aae-b3f0-59261dea964d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:06.910281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5648d8-467f-4aae-b3f0-59261dea964d None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:06.911230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5648d8-467f-4aae-b3f0-59261dea964d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:06.911735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5648d8-467f-4aae-b3f0-59261dea964d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:06.914241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5648d8-467f-4aae-b3f0-59261dea964d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:06.935332 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50a06f-ede1-4c73-b011-f1896e6eae96 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:06.937021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 19/34] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:06.940215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5648d8-467f-4aae-b3f0-59261dea964d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:06.985358 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6267-4572-454b-8cc6-c8a16fcf2971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:06.985990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6267-4572-454b-8cc6-c8a16fcf2971 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:06.986275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6267-4572-454b-8cc6-c8a16fcf2971 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:06.986552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6267-4572-454b-8cc6-c8a16fcf2971 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:06.988085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e6267-4572-454b-8cc6-c8a16fcf2971 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:06.989515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e6267-4572-454b-8cc6-c8a16fcf2971 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:07.008620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 16/35] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Aug 4 02:22:06 2022] POST /identity/v3/roles => generated 225 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:07.009300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6267-4572-454b-8cc6-c8a16fcf2971 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:07.060192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:07.146657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6267-4572-454b-8cc6-c8a16fcf2971 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:07.162506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5648d8-467f-4aae-b3f0-59261dea964d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:07.176171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:07.190725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb1a21-1105-4b06-9eda-0c8cb7c9a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:07.191610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1a21-1105-4b06-9eda-0c8cb7c9a039 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.192035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1a21-1105-4b06-9eda-0c8cb7c9a039 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.192456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1a21-1105-4b06-9eda-0c8cb7c9a039 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.193582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb1a21-1105-4b06-9eda-0c8cb7c9a039 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:07.195297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb1a21-1105-4b06-9eda-0c8cb7c9a039 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:07.211179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c3f37-3981-4c03-afc2-33ace83d16c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:07.211844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c3f37-3981-4c03-afc2-33ace83d16c6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.212189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c3f37-3981-4c03-afc2-33ace83d16c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.212587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c3f37-3981-4c03-afc2-33ace83d16c6 None admin] PATH_INFO: `/v3/users/525c51ec9f124dbfa5960c298384d18f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.215408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c3f37-3981-4c03-afc2-33ace83d16c6 None admin] RBAC: Authorizing `identity:get_user(user_id=525c51ec9f124dbfa5960c298384d18f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:07.216460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c3f37-3981-4c03-afc2-33ace83d16c6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:07.218762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 20/36] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:06 2022] GET /identity/v3/users/525c51ec9f124dbfa5960c298384d18f => generated 247 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:07.218881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfeb54-264c-4b17-a3d1-4adf5818a6c9 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.219259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfeb54-264c-4b17-a3d1-4adf5818a6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.219431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfeb54-264c-4b17-a3d1-4adf5818a6c9 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.221097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 21/37] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:07.225857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfeb54-264c-4b17-a3d1-4adf5818a6c9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:07.239202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 17/38] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:22:07 2022] POST /identity/v3/projects => generated 301 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:07.240534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c927-d6eb-4385-95d0-a22260fb8f0f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.240658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c927-d6eb-4385-95d0-a22260fb8f0f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.240929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3c927-d6eb-4385-95d0-a22260fb8f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.263294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e0b3c927-d6eb-4385-95d0-a22260fb8f0f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:07.264878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e0b3c927-d6eb-4385-95d0-a22260fb8f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:07.344135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 18/39] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:07.345566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828ab27-32b0-4c39-b568-42b73e10e260 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.345855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828ab27-32b0-4c39-b568-42b73e10e260 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.346132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828ab27-32b0-4c39-b568-42b73e10e260 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.351705 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 19/40] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:07.353597 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285297-6a72-478d-8b20-fba10b95403e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.353899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285297-6a72-478d-8b20-fba10b95403e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.354178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285297-6a72-478d-8b20-fba10b95403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.365861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfeb54-264c-4b17-a3d1-4adf5818a6c9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:07.378224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2f285297-6a72-478d-8b20-fba10b95403e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:07.379444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2f285297-6a72-478d-8b20-fba10b95403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:07.382795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:07.407597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8dcf1-4d6c-4ad6-a552-59d8ddd83bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:07.408477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8dcf1-4d6c-4ad6-a552-59d8ddd83bbd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.408896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8dcf1-4d6c-4ad6-a552-59d8ddd83bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.409349 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8dcf1-4d6c-4ad6-a552-59d8ddd83bbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.410995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8dcf1-4d6c-4ad6-a552-59d8ddd83bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:07.413157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8dcf1-4d6c-4ad6-a552-59d8ddd83bbd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:07.414426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 22/41] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:07.417359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8dcf1-4d6c-4ad6-a552-59d8ddd83bbd None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:07.462205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 20/42] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:07.463316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f285297-6a72-478d-8b20-fba10b95403e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:07.476015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:07.534685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8dcf1-4d6c-4ad6-a552-59d8ddd83bbd None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:07.563953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f285297-6a72-478d-8b20-fba10b95403e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:07.569124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f8fb-c8df-4064-ad02-99fd230b1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:07.569779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f8fb-c8df-4064-ad02-99fd230b1e04 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.570062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f8fb-c8df-4064-ad02-99fd230b1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.570336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9f8fb-c8df-4064-ad02-99fd230b1e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.571053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f8fb-c8df-4064-ad02-99fd230b1e04 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:07.572453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9f8fb-c8df-4064-ad02-99fd230b1e04 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:07.598226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d271691-7b6c-45de-ad4f-279fe9f75788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:07.598900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d271691-7b6c-45de-ad4f-279fe9f75788 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.599185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d271691-7b6c-45de-ad4f-279fe9f75788 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.599467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d271691-7b6c-45de-ad4f-279fe9f75788 None admin] PATH_INFO: `/v3/domains/default/users/525c51ec9f124dbfa5960c298384d18f/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.601716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d271691-7b6c-45de-ad4f-279fe9f75788 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=525c51ec9f124dbfa5960c298384d18f, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:07.603821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d271691-7b6c-45de-ad4f-279fe9f75788 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:07.616515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:07.620254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 21/43] 10.222.0.69 () {58 vars in 1361 bytes} [Thu Aug 4 02:22:07 2022] PUT /identity/v3/domains/default/users/525c51ec9f124dbfa5960c298384d18f/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:07.634868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d271691-7b6c-45de-ad4f-279fe9f75788 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:07.693478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Aug 4 02:22:07 2022] POST /identity/v3/roles => generated 223 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:07.750462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d271691-7b6c-45de-ad4f-279fe9f75788 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:07.791686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394cee3-ce33-4af9-82bf-11cd3b3c7dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:07.792636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394cee3-ce33-4af9-82bf-11cd3b3c7dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.793057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394cee3-ce33-4af9-82bf-11cd3b3c7dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.793584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394cee3-ce33-4af9-82bf-11cd3b3c7dd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.795804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394cee3-ce33-4af9-82bf-11cd3b3c7dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:07.797490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394cee3-ce33-4af9-82bf-11cd3b3c7dd4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:07.799333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 22/45] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:07.805595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f8fb-c8df-4064-ad02-99fd230b1e04 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:07.916011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9f8fb-c8df-4064-ad02-99fd230b1e04 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:07.917718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:07.951887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cf4f7-e787-45fc-b178-94a6a2adb586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:07.952542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cf4f7-e787-45fc-b178-94a6a2adb586 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:07.952827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cf4f7-e787-45fc-b178-94a6a2adb586 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:07.953103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cf4f7-e787-45fc-b178-94a6a2adb586 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:07.953903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cf4f7-e787-45fc-b178-94a6a2adb586 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:07.955479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cf4f7-e787-45fc-b178-94a6a2adb586 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:07.986267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:22:07 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:09.658453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebc10d-69e5-4d73-86e2-c8d2f7250ddc None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:09.658953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebc10d-69e5-4d73-86e2-c8d2f7250ddc None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:09.659033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebc10d-69e5-4d73-86e2-c8d2f7250ddc None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:09.660330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 23/47] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:09.666174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456912d0-c7e2-4819-bf5a-e5a4d304cb4a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:09.666611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456912d0-c7e2-4819-bf5a-e5a4d304cb4a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:09.666783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456912d0-c7e2-4819-bf5a-e5a4d304cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:09.685320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-456912d0-c7e2-4819-bf5a-e5a4d304cb4a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:09.686849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-456912d0-c7e2-4819-bf5a-e5a4d304cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:09.751821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 25/48] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:09.774083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebc10d-69e5-4d73-86e2-c8d2f7250ddc None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:09.840431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:09.874752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebc10d-69e5-4d73-86e2-c8d2f7250ddc None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:09.906479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fcdd4-9283-43b7-bd69-fdf32e894fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:09.907376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fcdd4-9283-43b7-bd69-fdf32e894fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:09.907653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fcdd4-9283-43b7-bd69-fdf32e894fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:09.907923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fcdd4-9283-43b7-bd69-fdf32e894fe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:09.919678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fcdd4-9283-43b7-bd69-fdf32e894fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-335fcdd4-9283-43b7-bd69-fdf32e894fe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:09.925799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:09.926691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:09.927509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 24/49] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:09.932756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456912d0-c7e2-4819-bf5a-e5a4d304cb4a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:09.966823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a59f9-52dc-44d3-8d33-a98355b06925 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:09.967107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a59f9-52dc-44d3-8d33-a98355b06925 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:09.967382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a59f9-52dc-44d3-8d33-a98355b06925 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:09.968719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 25/50] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:22:09.973572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24515d7b-983a-4e86-a308-c9edad47a3ed None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:09.973854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24515d7b-983a-4e86-a308-c9edad47a3ed None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:09.974131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24515d7b-983a-4e86-a308-c9edad47a3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:09.992302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-24515d7b-983a-4e86-a308-c9edad47a3ed None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:09.993535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-24515d7b-983a-4e86-a308-c9edad47a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:10.018774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:10.035876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456912d0-c7e2-4819-bf5a-e5a4d304cb4a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:10.061448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 26/51] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:10.068945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d4a67-2777-4508-b8ee-5d904f97d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:10.069608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d4a67-2777-4508-b8ee-5d904f97d3ab None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:10.069887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d4a67-2777-4508-b8ee-5d904f97d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:10.070157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d4a67-2777-4508-b8ee-5d904f97d3ab None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:10.070889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d4a67-2777-4508-b8ee-5d904f97d3ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:10.071186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d4a67-2777-4508-b8ee-5d904f97d3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:10.073096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d4a67-2777-4508-b8ee-5d904f97d3ab None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:10.081017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 26/52] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:10.086289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d4a67-2777-4508-b8ee-5d904f97d3ab None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:10.086404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24515d7b-983a-4e86-a308-c9edad47a3ed None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:10.142799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:10.184195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24515d7b-983a-4e86-a308-c9edad47a3ed None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:10.184905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d4a67-2777-4508-b8ee-5d904f97d3ab None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:10.218273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02151323-57e5-4fe0-a792-bf588217538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:10.218731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca51bf-9fdf-4f22-a7a8-82833ba8cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:10.218896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151323-57e5-4fe0-a792-bf588217538f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:10.219174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151323-57e5-4fe0-a792-bf588217538f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:10.219366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca51bf-9fdf-4f22-a7a8-82833ba8cb27 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:10.219453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02151323-57e5-4fe0-a792-bf588217538f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:10.219648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca51bf-9fdf-4f22-a7a8-82833ba8cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:10.219932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca51bf-9fdf-4f22-a7a8-82833ba8cb27 None admin] PATH_INFO: `/v3/users/525c51ec9f124dbfa5960c298384d18f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:10.220562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02151323-57e5-4fe0-a792-bf588217538f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:10.221094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca51bf-9fdf-4f22-a7a8-82833ba8cb27 None admin] RBAC: Authorizing `identity:get_user(user_id=525c51ec9f124dbfa5960c298384d18f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:10.222029 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02151323-57e5-4fe0-a792-bf588217538f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:10.222549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca51bf-9fdf-4f22-a7a8-82833ba8cb27 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:10.223602 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 27/53] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:10.224217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 27/54] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:10 2022] GET /identity/v3/users/525c51ec9f124dbfa5960c298384d18f => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:10.229319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02151323-57e5-4fe0-a792-bf588217538f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:10.229475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca51bf-9fdf-4f22-a7a8-82833ba8cb27 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:10.245525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:10.328598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02151323-57e5-4fe0-a792-bf588217538f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:10.328910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca51bf-9fdf-4f22-a7a8-82833ba8cb27 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:10.354596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:10.361214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc54df0-36be-4224-bb2b-291d4a502cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:10.361883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc54df0-36be-4224-bb2b-291d4a502cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:10.362167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc54df0-36be-4224-bb2b-291d4a502cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:10.362443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc54df0-36be-4224-bb2b-291d4a502cd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:10.363271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98179d96-ed0d-4ce6-baa6-939c1afa0ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:10.363569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc54df0-36be-4224-bb2b-291d4a502cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:10.363874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179d96-ed0d-4ce6-baa6-939c1afa0ea1 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:10.364155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179d96-ed0d-4ce6-baa6-939c1afa0ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:10.364428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179d96-ed0d-4ce6-baa6-939c1afa0ea1 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:10.365018 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc54df0-36be-4224-bb2b-291d4a502cd5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:10.365129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98179d96-ed0d-4ce6-baa6-939c1afa0ea1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:10.366521 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98179d96-ed0d-4ce6-baa6-939c1afa0ea1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:10.366662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 28/55] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:10.372299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc54df0-36be-4224-bb2b-291d4a502cd5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:10.392634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 28/56] 10.222.0.69 () {60 vars in 1140 bytes} [Thu Aug 4 02:22:10 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:10.460468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:10.481015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc54df0-36be-4224-bb2b-291d4a502cd5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:10.516037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a9809-49e9-4fdc-9e07-783821c97cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:10.516667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a9809-49e9-4fdc-9e07-783821c97cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:10.516947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a9809-49e9-4fdc-9e07-783821c97cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:10.517219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a9809-49e9-4fdc-9e07-783821c97cc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:10.518043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a9809-49e9-4fdc-9e07-783821c97cc9 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.domain.id=default, user.id=525c51ec9f124dbfa5960c298384d18f) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:10.518349 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a9809-49e9-4fdc-9e07-783821c97cc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:10.519830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a9809-49e9-4fdc-9e07-783821c97cc9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:10.526262 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 29/57] 10.222.0.69 () {56 vars in 1322 bytes} [Thu Aug 4 02:22:10 2022] GET /identity/v3/role_assignments?user.id=525c51ec9f124dbfa5960c298384d18f&scope.domain.id=default&role.id=999cac3070e64b82b981258349005963 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:12.374907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724866-2b86-4bf0-bcf1-5a8bb2599bb9 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:12.375418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724866-2b86-4bf0-bcf1-5a8bb2599bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:12.375500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724866-2b86-4bf0-bcf1-5a8bb2599bb9 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:12.376805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 29/58] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:12.381793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b61e6-01a4-42fa-91d4-ad0012b46df8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:12.382179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b61e6-01a4-42fa-91d4-ad0012b46df8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:12.382526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b61e6-01a4-42fa-91d4-ad0012b46df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:12.399968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-474b61e6-01a4-42fa-91d4-ad0012b46df8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:12.401142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-474b61e6-01a4-42fa-91d4-ad0012b46df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:12.465028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 30/59] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:12.488607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724866-2b86-4bf0-bcf1-5a8bb2599bb9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:12.591602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724866-2b86-4bf0-bcf1-5a8bb2599bb9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:12.624048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44421a4-9f7f-4f38-91c2-2aa4e811e668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:12.624667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44421a4-9f7f-4f38-91c2-2aa4e811e668 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:12.624998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44421a4-9f7f-4f38-91c2-2aa4e811e668 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:12.625228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44421a4-9f7f-4f38-91c2-2aa4e811e668 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:12.626393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44421a4-9f7f-4f38-91c2-2aa4e811e668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:12.627823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44421a4-9f7f-4f38-91c2-2aa4e811e668 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:12.629414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 30/60] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:12.634807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b61e6-01a4-42fa-91d4-ad0012b46df8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:12.707546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:12.730750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b61e6-01a4-42fa-91d4-ad0012b46df8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:12.762931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ce83d-0ce6-4b43-91eb-6dabc9a0f488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:12.763533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce83d-0ce6-4b43-91eb-6dabc9a0f488 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:12.763812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce83d-0ce6-4b43-91eb-6dabc9a0f488 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:12.764087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ce83d-0ce6-4b43-91eb-6dabc9a0f488 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:12.764751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ce83d-0ce6-4b43-91eb-6dabc9a0f488 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:12.766204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ce83d-0ce6-4b43-91eb-6dabc9a0f488 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:12.795068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 31/61] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:22:12 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:15.855507 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99a9fb-e157-4da6-89bb-ee073b632d88 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:15.855993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99a9fb-e157-4da6-89bb-ee073b632d88 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:15.855993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99a9fb-e157-4da6-89bb-ee073b632d88 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:15.857318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 31/62] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:15.862571 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be20f-2ff6-448f-9cfa-cebfaed7b0e2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:15.863376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be20f-2ff6-448f-9cfa-cebfaed7b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:15.863855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be20f-2ff6-448f-9cfa-cebfaed7b0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:15.887620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-618be20f-2ff6-448f-9cfa-cebfaed7b0e2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:15.889171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-618be20f-2ff6-448f-9cfa-cebfaed7b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:15.968010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f51d27-9e4f-4849-b829-d637b8f4936b None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:15.968292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f51d27-9e4f-4849-b829-d637b8f4936b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:15.968736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f51d27-9e4f-4849-b829-d637b8f4936b None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:15.970542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 32/63] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:15.979162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a690-fc78-407f-bd0d-bbed57692627 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:15.979628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 32/64] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:15.979752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a690-fc78-407f-bd0d-bbed57692627 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:15.980054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a690-fc78-407f-bd0d-bbed57692627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.018283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ad57a690-fc78-407f-bd0d-bbed57692627 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:16.018489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be20f-2ff6-448f-9cfa-cebfaed7b0e2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.019871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ad57a690-fc78-407f-bd0d-bbed57692627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:16.094299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.097711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.126458 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 33/65] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:16.132971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5e7a-ee2b-4289-93a8-1d65b21f1f51 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.132971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5e7a-ee2b-4289-93a8-1d65b21f1f51 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.132971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5e7a-ee2b-4289-93a8-1d65b21f1f51 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.132971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 34/66] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:16.137480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be20f-2ff6-448f-9cfa-cebfaed7b0e2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.145160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718514e7-889a-4eb1-bafd-711edbfb4726 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.145481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718514e7-889a-4eb1-bafd-711edbfb4726 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.145766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718514e7-889a-4eb1-bafd-711edbfb4726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.174415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-718514e7-889a-4eb1-bafd-711edbfb4726 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:16.176847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-718514e7-889a-4eb1-bafd-711edbfb4726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:16.187503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc4c90-c974-4041-963f-76ff4874517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.188492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc4c90-c974-4041-963f-76ff4874517e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.188906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc4c90-c974-4041-963f-76ff4874517e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.189436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc4c90-c974-4041-963f-76ff4874517e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.201658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc4c90-c974-4041-963f-76ff4874517e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-5cfc4c90-c974-4041-963f-76ff4874517e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:16.207369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:16.208411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:16.209489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:16.211708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 33/67] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:16.213534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc4c90-c974-4041-963f-76ff4874517e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.248769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 35/68] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 04 02:22:16.249714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718514e7-889a-4eb1-bafd-711edbfb4726 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.327126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc4c90-c974-4041-963f-76ff4874517e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.353162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.357470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718514e7-889a-4eb1-bafd-711edbfb4726 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.365869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.367242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f04d-aec4-4fd0-a9a5-97f3cf827dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.367994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f04d-aec4-4fd0-a9a5-97f3cf827dcc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.368743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f04d-aec4-4fd0-a9a5-97f3cf827dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.369466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640f04d-aec4-4fd0-a9a5-97f3cf827dcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.382763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640f04d-aec4-4fd0-a9a5-97f3cf827dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-5640f04d-aec4-4fd0-a9a5-97f3cf827dcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:16.388370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:16.389190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:16.389968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:16.390566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f04d-aec4-4fd0-a9a5-97f3cf827dcc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.402653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14713fd9-bf27-4d85-9c52-9cf33256f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.403820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14713fd9-bf27-4d85-9c52-9cf33256f326 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.404287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14713fd9-bf27-4d85-9c52-9cf33256f326 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.404567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14713fd9-bf27-4d85-9c52-9cf33256f326 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.405281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14713fd9-bf27-4d85-9c52-9cf33256f326 None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:16.405622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14713fd9-bf27-4d85-9c52-9cf33256f326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.407244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14713fd9-bf27-4d85-9c52-9cf33256f326 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.416176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 36/70] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:16.418588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1555f-b3d3-4215-a1ea-1c816b907707 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.418876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1555f-b3d3-4215-a1ea-1c816b907707 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.419152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1555f-b3d3-4215-a1ea-1c816b907707 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.420756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 37/71] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:16.421093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1555f-b3d3-4215-a1ea-1c816b907707 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.502309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640f04d-aec4-4fd0-a9a5-97f3cf827dcc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.528009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1555f-b3d3-4215-a1ea-1c816b907707 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.539104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27514176-1924-4be3-b23f-883afd7a6019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.539742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27514176-1924-4be3-b23f-883afd7a6019 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.540025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27514176-1924-4be3-b23f-883afd7a6019 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.540347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27514176-1924-4be3-b23f-883afd7a6019 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.551570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27514176-1924-4be3-b23f-883afd7a6019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-27514176-1924-4be3-b23f-883afd7a6019 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:16.557057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:16.557907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:16.558640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 35/72] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:16.559243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27514176-1924-4be3-b23f-883afd7a6019 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.569503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a382f-b97f-41ac-87e5-4135d92aa06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.570218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a382f-b97f-41ac-87e5-4135d92aa06c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.570592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a382f-b97f-41ac-87e5-4135d92aa06c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.570940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a382f-b97f-41ac-87e5-4135d92aa06c None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.572343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a382f-b97f-41ac-87e5-4135d92aa06c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:16.572715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a382f-b97f-41ac-87e5-4135d92aa06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.574262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a382f-b97f-41ac-87e5-4135d92aa06c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.583941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 38/73] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:16.588438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24d959-7cd8-4614-8a84-fe6a11631db3 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.588438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24d959-7cd8-4614-8a84-fe6a11631db3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.588438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24d959-7cd8-4614-8a84-fe6a11631db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.604191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9c24d959-7cd8-4614-8a84-fe6a11631db3 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:16.605403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9c24d959-7cd8-4614-8a84-fe6a11631db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:16.614933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.631778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.674620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27514176-1924-4be3-b23f-883afd7a6019 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.674768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 39/74] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:16.675494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24d959-7cd8-4614-8a84-fe6a11631db3 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.715329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ae8e-9d96-48fa-8788-855ecb3fdf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.715963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ae8e-9d96-48fa-8788-855ecb3fdf2e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.716254 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ae8e-9d96-48fa-8788-855ecb3fdf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.716533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ae8e-9d96-48fa-8788-855ecb3fdf2e None admin] PATH_INFO: `/v3/users/4fa4130cd11045fca9174faec75a53cd` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.729712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2ae8e-9d96-48fa-8788-855ecb3fdf2e None admin] RBAC: Authorizing `identity:get_user(user_id=4fa4130cd11045fca9174faec75a53cd)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.731186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2ae8e-9d96-48fa-8788-855ecb3fdf2e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.732810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 36/75] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/users/4fa4130cd11045fca9174faec75a53cd => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:16.732810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ae8e-9d96-48fa-8788-855ecb3fdf2e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.772503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24d959-7cd8-4614-8a84-fe6a11631db3 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.805229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc483c8-729e-4160-ba24-52438c84b35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.806381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc483c8-729e-4160-ba24-52438c84b35a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.806663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc483c8-729e-4160-ba24-52438c84b35a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.806932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc483c8-729e-4160-ba24-52438c84b35a None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.807638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc483c8-729e-4160-ba24-52438c84b35a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:16.807934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc483c8-729e-4160-ba24-52438c84b35a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.809295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc483c8-729e-4160-ba24-52438c84b35a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.816926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 40/76] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:16.818156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1c2b-3a46-4fdd-a923-21a03cde80ee None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.818442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1c2b-3a46-4fdd-a923-21a03cde80ee None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.818718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa1c2b-3a46-4fdd-a923-21a03cde80ee None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.819916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 41/77] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:16.820608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa1c2b-3a46-4fdd-a923-21a03cde80ee None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.833419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.837966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ae8e-9d96-48fa-8788-855ecb3fdf2e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.846661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:16.873101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1043084-2a4b-4571-941d-5b39b9750f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.873779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1043084-2a4b-4571-941d-5b39b9750f2e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.874059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1043084-2a4b-4571-941d-5b39b9750f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.874333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1043084-2a4b-4571-941d-5b39b9750f2e None admin] PATH_INFO: `/v3/users/525c51ec9f124dbfa5960c298384d18f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.875499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1043084-2a4b-4571-941d-5b39b9750f2e None admin] RBAC: Authorizing `identity:get_user(user_id=525c51ec9f124dbfa5960c298384d18f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:16.876947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1043084-2a4b-4571-941d-5b39b9750f2e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:16.878574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 37/78] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/users/525c51ec9f124dbfa5960c298384d18f => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:16.882260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1043084-2a4b-4571-941d-5b39b9750f2e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.925260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa1c2b-3a46-4fdd-a923-21a03cde80ee None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:16.957473 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e61721-899c-497e-9dee-779eb922c95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:16.958153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e61721-899c-497e-9dee-779eb922c95c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:16.958516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e61721-899c-497e-9dee-779eb922c95c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:16.958793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e61721-899c-497e-9dee-779eb922c95c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:16.968476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e61721-899c-497e-9dee-779eb922c95c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-72e61721-899c-497e-9dee-779eb922c95c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:16.973838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:16.974695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:16.975460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 42/79] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:16.976077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e61721-899c-497e-9dee-779eb922c95c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:16.984055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1043084-2a4b-4571-941d-5b39b9750f2e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.017875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948202a-d6ba-44c1-bf64-1a099f88c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.018491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948202a-d6ba-44c1-bf64-1a099f88c577 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.018774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948202a-d6ba-44c1-bf64-1a099f88c577 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.019050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948202a-d6ba-44c1-bf64-1a099f88c577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.052814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.059611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.077667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e61721-899c-497e-9dee-779eb922c95c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.086968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948202a-d6ba-44c1-bf64-1a099f88c577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.088461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948202a-d6ba-44c1-bf64-1a099f88c577 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.109949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc865d-727e-4166-91a9-b6958a46e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.110580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc865d-727e-4166-91a9-b6958a46e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.110865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc865d-727e-4166-91a9-b6958a46e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.111144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc865d-727e-4166-91a9-b6958a46e4e7 None admin] PATH_INFO: `/v3/users/4fa4130cd11045fca9174faec75a53cd` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.112323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc865d-727e-4166-91a9-b6958a46e4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=4fa4130cd11045fca9174faec75a53cd)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.113786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc865d-727e-4166-91a9-b6958a46e4e7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.115379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 43/80] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/users/4fa4130cd11045fca9174faec75a53cd => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:17.115379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9849d-a50f-4fad-ab7b-9c96e58e96c9 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.115379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9849d-a50f-4fad-ab7b-9c96e58e96c9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.115379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9849d-a50f-4fad-ab7b-9c96e58e96c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.134535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e2a9849d-a50f-4fad-ab7b-9c96e58e96c9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:17.135715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e2a9849d-a50f-4fad-ab7b-9c96e58e96c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:17.193273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 38/81] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:17.194383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948202a-d6ba-44c1-bf64-1a099f88c577 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.202042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 44/82] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:17.203093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9849d-a50f-4fad-ab7b-9c96e58e96c9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.269907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.284663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.303886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9849d-a50f-4fad-ab7b-9c96e58e96c9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.304332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948202a-d6ba-44c1-bf64-1a099f88c577 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.336198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6750db-c0bf-45c8-80d1-30edf89c918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.336558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d029d3-d68e-44f5-9930-9171ec64b4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.336810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6750db-c0bf-45c8-80d1-30edf89c918f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.337634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6750db-c0bf-45c8-80d1-30edf89c918f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.337812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d029d3-d68e-44f5-9930-9171ec64b4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.337928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6750db-c0bf-45c8-80d1-30edf89c918f None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.338070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d029d3-d68e-44f5-9930-9171ec64b4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.338206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d029d3-d68e-44f5-9930-9171ec64b4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.338608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6750db-c0bf-45c8-80d1-30edf89c918f None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:17.338904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6750db-c0bf-45c8-80d1-30edf89c918f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.340272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6750db-c0bf-45c8-80d1-30edf89c918f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.348242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 45/83] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:17.348242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6750db-c0bf-45c8-80d1-30edf89c918f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.404980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d029d3-d68e-44f5-9930-9171ec64b4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.406756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d029d3-d68e-44f5-9930-9171ec64b4c6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.445216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6750db-c0bf-45c8-80d1-30edf89c918f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.470947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.481488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9491-7e34-4d62-98ed-2f6a6606b6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.482101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9491-7e34-4d62-98ed-2f6a6606b6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.482388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9491-7e34-4d62-98ed-2f6a6606b6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.482665 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9491-7e34-4d62-98ed-2f6a6606b6b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.494283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.505766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 39/84] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:17.506605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d029d3-d68e-44f5-9930-9171ec64b4c6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.556658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d9491-7e34-4d62-98ed-2f6a6606b6b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.558452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d9491-7e34-4d62-98ed-2f6a6606b6b4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.609691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d029d3-d68e-44f5-9930-9171ec64b4c6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.643055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c2a51-6520-47b9-8479-917f55a20d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.643689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c2a51-6520-47b9-8479-917f55a20d2c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.643974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c2a51-6520-47b9-8479-917f55a20d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.644251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c2a51-6520-47b9-8479-917f55a20d2c None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.645423 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c2a51-6520-47b9-8479-917f55a20d2c None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.646869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c2a51-6520-47b9-8479-917f55a20d2c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.648526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 40/85] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:17.651095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c2a51-6520-47b9-8479-917f55a20d2c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.657905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 46/86] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:17.658748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9491-7e34-4d62-98ed-2f6a6606b6b4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.688107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.700024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.752143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c2a51-6520-47b9-8479-917f55a20d2c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.756063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9491-7e34-4d62-98ed-2f6a6606b6b4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.785861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a378bb-edeb-467f-bc2a-5e8485297992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.786503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a378bb-edeb-467f-bc2a-5e8485297992 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.786786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a378bb-edeb-467f-bc2a-5e8485297992 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.787065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a378bb-edeb-467f-bc2a-5e8485297992 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.788195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a378bb-edeb-467f-bc2a-5e8485297992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.789704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a378bb-edeb-467f-bc2a-5e8485297992 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.790848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3eb08-ea3a-4359-852b-591c95737df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.791513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3eb08-ea3a-4359-852b-591c95737df0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.791796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3eb08-ea3a-4359-852b-591c95737df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.791922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 41/87] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:17.792075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3eb08-ea3a-4359-852b-591c95737df0 None admin] PATH_INFO: `/v3/users/4fa4130cd11045fca9174faec75a53cd` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.792601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a378bb-edeb-467f-bc2a-5e8485297992 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.793379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3eb08-ea3a-4359-852b-591c95737df0 None admin] RBAC: Authorizing `identity:get_user(user_id=4fa4130cd11045fca9174faec75a53cd)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.794940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3eb08-ea3a-4359-852b-591c95737df0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.796695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 47/88] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/users/4fa4130cd11045fca9174faec75a53cd => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:17.798123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3eb08-ea3a-4359-852b-591c95737df0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.891965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a378bb-edeb-467f-bc2a-5e8485297992 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.894961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.896007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3eb08-ea3a-4359-852b-591c95737df0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:17.906802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:17.927837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40d067-9afe-41cc-9342-65abcfe96e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.928472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40d067-9afe-41cc-9342-65abcfe96e97 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.928755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40d067-9afe-41cc-9342-65abcfe96e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.929033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40d067-9afe-41cc-9342-65abcfe96e97 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.930053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f78d12-4d1f-4898-baf3-e56795db2902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:17.930481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40d067-9afe-41cc-9342-65abcfe96e97 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.930688 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f78d12-4d1f-4898-baf3-e56795db2902 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:17.931583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f78d12-4d1f-4898-baf3-e56795db2902 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:17.931863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f78d12-4d1f-4898-baf3-e56795db2902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:17.932252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40d067-9afe-41cc-9342-65abcfe96e97 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.932644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f78d12-4d1f-4898-baf3-e56795db2902 None admin] RBAC: Adding query filter params (role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5, user.id=4fa4130cd11045fca9174faec75a53cd) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:17.932955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f78d12-4d1f-4898-baf3-e56795db2902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:17.933987 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 42/89] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:17.934401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f78d12-4d1f-4898-baf3-e56795db2902 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:17.934747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40d067-9afe-41cc-9342-65abcfe96e97 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:17.944691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 48/90] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/role_assignments?user.id=4fa4130cd11045fca9174faec75a53cd&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=2fcd0ee644864d67833017de80ba1627 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:17.945511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f78d12-4d1f-4898-baf3-e56795db2902 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:18.052659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40d067-9afe-41cc-9342-65abcfe96e97 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:18.059592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f78d12-4d1f-4898-baf3-e56795db2902 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:18.091010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e6e1-36eb-4ff6-9f35-cbc2576acf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:18.091664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e6e1-36eb-4ff6-9f35-cbc2576acf88 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:18.091946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e6e1-36eb-4ff6-9f35-cbc2576acf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:18.092221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e6e1-36eb-4ff6-9f35-cbc2576acf88 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:18.093421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073e6e1-36eb-4ff6-9f35-cbc2576acf88 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:18.094925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073e6e1-36eb-4ff6-9f35-cbc2576acf88 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:18.096755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 43/91] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:17 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:18.097416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e6e1-36eb-4ff6-9f35-cbc2576acf88 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:18.099758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fe779-4aff-4c72-a4b2-5dd65b678571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:18.100389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fe779-4aff-4c72-a4b2-5dd65b678571 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:18.100678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fe779-4aff-4c72-a4b2-5dd65b678571 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:18.101677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fe779-4aff-4c72-a4b2-5dd65b678571 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:18.101677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fe779-4aff-4c72-a4b2-5dd65b678571 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:18.103799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fe779-4aff-4c72-a4b2-5dd65b678571 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:18.133171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 49/92] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:22:17 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:18.135313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fe779-4aff-4c72-a4b2-5dd65b678571 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:18.155977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:18.177441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:18.219365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e6e1-36eb-4ff6-9f35-cbc2576acf88 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:18.262969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b63e60-dbb0-4ca0-939d-c083b65e573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:18.263706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b63e60-dbb0-4ca0-939d-c083b65e573b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:18.263999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b63e60-dbb0-4ca0-939d-c083b65e573b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:18.264530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b63e60-dbb0-4ca0-939d-c083b65e573b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:18.272399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fe779-4aff-4c72-a4b2-5dd65b678571 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:18.323922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530c941-d47c-4d0f-8304-3534367de2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:18.325185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530c941-d47c-4d0f-8304-3534367de2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:18.325960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530c941-d47c-4d0f-8304-3534367de2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:18.326377 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530c941-d47c-4d0f-8304-3534367de2a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:18.327604 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530c941-d47c-4d0f-8304-3534367de2a8 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5, user.id=525c51ec9f124dbfa5960c298384d18f) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:18.327920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530c941-d47c-4d0f-8304-3534367de2a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:18.329815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530c941-d47c-4d0f-8304-3534367de2a8 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:18.335772 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 50/93] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:18 2022] GET /identity/v3/role_assignments?user.id=525c51ec9f124dbfa5960c298384d18f&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=999cac3070e64b82b981258349005963 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:18.336451 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530c941-d47c-4d0f-8304-3534367de2a8 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:18.362184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b63e60-dbb0-4ca0-939d-c083b65e573b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:18.363969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b63e60-dbb0-4ca0-939d-c083b65e573b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:18.417471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:18.471041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:18.483776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530c941-d47c-4d0f-8304-3534367de2a8 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:18.512772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 44/94] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:18.518716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b63e60-dbb0-4ca0-939d-c083b65e573b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:18.544856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951eaee-66c7-4863-924c-55295a562c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:18.545526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951eaee-66c7-4863-924c-55295a562c87 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:18.545807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951eaee-66c7-4863-924c-55295a562c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:18.546081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951eaee-66c7-4863-924c-55295a562c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:18.546887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951eaee-66c7-4863-924c-55295a562c87 None admin] RBAC: Adding query filter params (role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5, user.id=4fa4130cd11045fca9174faec75a53cd) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:18.547194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951eaee-66c7-4863-924c-55295a562c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:18.549676 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951eaee-66c7-4863-924c-55295a562c87 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:18.559756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 51/95] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:18 2022] GET /identity/v3/role_assignments?user.id=4fa4130cd11045fca9174faec75a53cd&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:18.644746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b63e60-dbb0-4ca0-939d-c083b65e573b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:18.684492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361276ff-21f0-434e-bc30-29642facba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:18.685460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361276ff-21f0-434e-bc30-29642facba24 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:18.685887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361276ff-21f0-434e-bc30-29642facba24 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:18.686306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361276ff-21f0-434e-bc30-29642facba24 None admin] PATH_INFO: `/v3/projects/857ac3a4e4414c25b406a2ff44e42f35` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:18.687716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361276ff-21f0-434e-bc30-29642facba24 None admin] RBAC: Authorizing `identity:get_project(project_id=857ac3a4e4414c25b406a2ff44e42f35)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:18.689370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361276ff-21f0-434e-bc30-29642facba24 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:18.691643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 45/96] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:18 2022] GET /identity/v3/projects/857ac3a4e4414c25b406a2ff44e42f35 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:18.698569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951eaee-66c7-4863-924c-55295a562c87 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:18.827161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951eaee-66c7-4863-924c-55295a562c87 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:18.864851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a044-47ab-4c37-82a3-ffbcee6f7f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:18.865506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a044-47ab-4c37-82a3-ffbcee6f7f20 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:18.865790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a044-47ab-4c37-82a3-ffbcee6f7f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:18.866067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a044-47ab-4c37-82a3-ffbcee6f7f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:18.866866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663a044-47ab-4c37-82a3-ffbcee6f7f20 None admin] RBAC: Adding query filter params (role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=857ac3a4e4414c25b406a2ff44e42f35, user.id=4fa4130cd11045fca9174faec75a53cd) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:18.867176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663a044-47ab-4c37-82a3-ffbcee6f7f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:18.869185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663a044-47ab-4c37-82a3-ffbcee6f7f20 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:18.875054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 52/97] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:18 2022] GET /identity/v3/role_assignments?user.id=4fa4130cd11045fca9174faec75a53cd&scope.project.id=857ac3a4e4414c25b406a2ff44e42f35&role.id=2fcd0ee644864d67833017de80ba1627 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:20.745012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556ab4-c28a-4b2e-9926-d6f867a81754 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.746097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556ab4-c28a-4b2e-9926-d6f867a81754 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.746618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556ab4-c28a-4b2e-9926-d6f867a81754 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.748190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 46/98] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:20.758513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43342025-32ef-4d71-8b61-1fca17574798 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.759493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43342025-32ef-4d71-8b61-1fca17574798 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.759673 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43342025-32ef-4d71-8b61-1fca17574798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.784040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-43342025-32ef-4d71-8b61-1fca17574798 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:20.785244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-43342025-32ef-4d71-8b61-1fca17574798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:20.802381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:20.855575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 53/99] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:20.876630 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556ab4-c28a-4b2e-9926-d6f867a81754 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:20.888834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:20.893626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9e96-4fcc-41e1-a6a9-d1d346d08ac2 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.893911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9e96-4fcc-41e1-a6a9-d1d346d08ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.894299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9e96-4fcc-41e1-a6a9-d1d346d08ac2 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.895794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 54/100] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:22:20.901083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24e54-9ae2-472c-9659-faa94cc5ffe2 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:20.901385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24e54-9ae2-472c-9659-faa94cc5ffe2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:20.901678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24e54-9ae2-472c-9659-faa94cc5ffe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:20.919835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f6b24e54-9ae2-472c-9659-faa94cc5ffe2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:20.920917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f6b24e54-9ae2-472c-9659-faa94cc5ffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:21.022351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 55/101] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:21.052178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556ab4-c28a-4b2e-9926-d6f867a81754 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.057514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b24e54-9ae2-472c-9659-faa94cc5ffe2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.138149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d302b-973a-4e25-915f-5671c2bd956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.138738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d302b-973a-4e25-915f-5671c2bd956f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.139022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d302b-973a-4e25-915f-5671c2bd956f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.139298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d302b-973a-4e25-915f-5671c2bd956f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.160044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d302b-973a-4e25-915f-5671c2bd956f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a46d302b-973a-4e25-915f-5671c2bd956f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:21.165450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:21.166301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:21.167033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:21.167595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.167662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 47/102] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:21.168631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c532fc-91bc-44b5-8a4b-269683575aef None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.173183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c532fc-91bc-44b5-8a4b-269683575aef None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.173183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c532fc-91bc-44b5-8a4b-269683575aef None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.173183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 48/103] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:21.175386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c532fc-91bc-44b5-8a4b-269683575aef None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.197756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b24e54-9ae2-472c-9659-faa94cc5ffe2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.235147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbaeda-96bc-4735-9a6b-9614b1ce401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.235790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbaeda-96bc-4735-9a6b-9614b1ce401d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.236070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbaeda-96bc-4735-9a6b-9614b1ce401d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.236343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbaeda-96bc-4735-9a6b-9614b1ce401d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.249372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbaeda-96bc-4735-9a6b-9614b1ce401d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-8dbbaeda-96bc-4735-9a6b-9614b1ce401d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:21.254565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:21.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:21.256343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 56/104] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:21.261655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee399c1-c54e-46fa-a54d-d7e723d194a1 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.261655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee399c1-c54e-46fa-a54d-d7e723d194a1 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.261655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee399c1-c54e-46fa-a54d-d7e723d194a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.280935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bee399c1-c54e-46fa-a54d-d7e723d194a1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:21.281626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.282422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bee399c1-c54e-46fa-a54d-d7e723d194a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:21.321123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c532fc-91bc-44b5-8a4b-269683575aef None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.351033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 57/105] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:21.352290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2229558-cd8e-417f-9ceb-1d1b123cc1d7 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.353102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2229558-cd8e-417f-9ceb-1d1b123cc1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.356419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2229558-cd8e-417f-9ceb-1d1b123cc1d7 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.359749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 58/106] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:21.360890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2229558-cd8e-417f-9ceb-1d1b123cc1d7 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.361698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bece9bf-f3d6-4b3f-90fb-ceafe406235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.362308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece9bf-f3d6-4b3f-90fb-ceafe406235f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.362867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece9bf-f3d6-4b3f-90fb-ceafe406235f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.363143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece9bf-f3d6-4b3f-90fb-ceafe406235f None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.366033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bece9bf-f3d6-4b3f-90fb-ceafe406235f None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:21.366591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bece9bf-f3d6-4b3f-90fb-ceafe406235f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.369584 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bece9bf-f3d6-4b3f-90fb-ceafe406235f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.383582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 49/107] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:21.384871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a41e14-9b26-4400-bebc-b1544e8b7306 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.385162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a41e14-9b26-4400-bebc-b1544e8b7306 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.389608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a41e14-9b26-4400-bebc-b1544e8b7306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.408757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-95a41e14-9b26-4400-bebc-b1544e8b7306 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:21.410099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-95a41e14-9b26-4400-bebc-b1544e8b7306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:21.443492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.477012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2229558-cd8e-417f-9ceb-1d1b123cc1d7 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.480663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 50/108] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:21.481550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a41e14-9b26-4400-bebc-b1544e8b7306 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.513774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb270e3-88b2-4410-bacf-5acf0a0ec2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.514397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb270e3-88b2-4410-bacf-5acf0a0ec2ee None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.514682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb270e3-88b2-4410-bacf-5acf0a0ec2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.514988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb270e3-88b2-4410-bacf-5acf0a0ec2ee None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.515814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb270e3-88b2-4410-bacf-5acf0a0ec2ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:21.516126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb270e3-88b2-4410-bacf-5acf0a0ec2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.517602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb270e3-88b2-4410-bacf-5acf0a0ec2ee None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.526984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 59/109] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:21.527655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb270e3-88b2-4410-bacf-5acf0a0ec2ee None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.542889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.585735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a41e14-9b26-4400-bebc-b1544e8b7306 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.621421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55a42-d0ad-4a4f-b5f6-7724a87a6a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.622192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55a42-d0ad-4a4f-b5f6-7724a87a6a15 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.622541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55a42-d0ad-4a4f-b5f6-7724a87a6a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.622921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55a42-d0ad-4a4f-b5f6-7724a87a6a15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.633712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a55a42-d0ad-4a4f-b5f6-7724a87a6a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-37a55a42-d0ad-4a4f-b5f6-7724a87a6a15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:21.638849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:21.639709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:21.640465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 51/110] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:21.641070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55a42-d0ad-4a4f-b5f6-7724a87a6a15 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.648160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb270e3-88b2-4410-bacf-5acf0a0ec2ee None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.686575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fb42e-f9ac-4c88-afe8-16b746433d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.687223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fb42e-f9ac-4c88-afe8-16b746433d0b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.687507 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fb42e-f9ac-4c88-afe8-16b746433d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.687787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fb42e-f9ac-4c88-afe8-16b746433d0b None admin] PATH_INFO: `/v3/users/4fa4130cd11045fca9174faec75a53cd` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.689072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fb42e-f9ac-4c88-afe8-16b746433d0b None admin] RBAC: Authorizing `identity:get_user(user_id=4fa4130cd11045fca9174faec75a53cd)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.690667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fb42e-f9ac-4c88-afe8-16b746433d0b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.692294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 60/111] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/users/4fa4130cd11045fca9174faec75a53cd => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:21.693177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fb42e-f9ac-4c88-afe8-16b746433d0b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.695886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.753184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55a42-d0ad-4a4f-b5f6-7724a87a6a15 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.773980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.789389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d92e35-729c-4096-b107-727dbee1a948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.790689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d92e35-729c-4096-b107-727dbee1a948 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.791032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d92e35-729c-4096-b107-727dbee1a948 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.791414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d92e35-729c-4096-b107-727dbee1a948 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.802473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d92e35-729c-4096-b107-727dbee1a948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:21.806440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fb42e-f9ac-4c88-afe8-16b746433d0b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f7d92e35-729c-4096-b107-727dbee1a948 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:21.808115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:21.809859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:21.811492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 52/112] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:21.812813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d92e35-729c-4096-b107-727dbee1a948 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.843024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d2da9-599b-4024-b687-25deb9313b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.843775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d2da9-599b-4024-b687-25deb9313b9a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.844063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d2da9-599b-4024-b687-25deb9313b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.844345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d2da9-599b-4024-b687-25deb9313b9a None admin] PATH_INFO: `/v3/users/84eb3314d4ce476a9b76302290d68077` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.861511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d2da9-599b-4024-b687-25deb9313b9a None admin] RBAC: Authorizing `identity:get_user(user_id=84eb3314d4ce476a9b76302290d68077)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.863084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d2da9-599b-4024-b687-25deb9313b9a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.864896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 61/113] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/users/84eb3314d4ce476a9b76302290d68077 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:21.870065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d2da9-599b-4024-b687-25deb9313b9a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.919283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d92e35-729c-4096-b107-727dbee1a948 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:21.935300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:21.955216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee37d6-c58c-4f4e-be02-18e054b4b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:21.955832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee37d6-c58c-4f4e-be02-18e054b4b201 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:21.956350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee37d6-c58c-4f4e-be02-18e054b4b201 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:21.956464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee37d6-c58c-4f4e-be02-18e054b4b201 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:21.957092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee37d6-c58c-4f4e-be02-18e054b4b201 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:21.957426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee37d6-c58c-4f4e-be02-18e054b4b201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:21.958822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee37d6-c58c-4f4e-be02-18e054b4b201 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:21.967969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 53/114] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:21.969267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee37d6-c58c-4f4e-be02-18e054b4b201 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:21.980639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d2da9-599b-4024-b687-25deb9313b9a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.015476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d80653-ad7a-4236-9369-ec31cca5b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.016123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d80653-ad7a-4236-9369-ec31cca5b89c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.016406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d80653-ad7a-4236-9369-ec31cca5b89c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.016684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d80653-ad7a-4236-9369-ec31cca5b89c None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.017526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:22.017884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d80653-ad7a-4236-9369-ec31cca5b89c None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.019330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d80653-ad7a-4236-9369-ec31cca5b89c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.021374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 62/115] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:22.022651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a13e-db3f-4df1-a9aa-9242fe192eb9 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.022946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a13e-db3f-4df1-a9aa-9242fe192eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.023228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a13e-db3f-4df1-a9aa-9242fe192eb9 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.025133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 63/116] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:22.030000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a13e-db3f-4df1-a9aa-9242fe192eb9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.085685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee37d6-c58c-4f4e-be02-18e054b4b201 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.120667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3bfc-6422-4eaa-9db8-867586703960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.121278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3bfc-6422-4eaa-9db8-867586703960 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.121596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3bfc-6422-4eaa-9db8-867586703960 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.121869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3bfc-6422-4eaa-9db8-867586703960 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.122570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3bfc-6422-4eaa-9db8-867586703960 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:22.122870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3bfc-6422-4eaa-9db8-867586703960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.124257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3bfc-6422-4eaa-9db8-867586703960 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.132388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 54/117] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:22.133245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3bfc-6422-4eaa-9db8-867586703960 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.144078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a13e-db3f-4df1-a9aa-9242fe192eb9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.172622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:22.182510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb170c-c6c7-4cdf-82c0-f05242681d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.183175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb170c-c6c7-4cdf-82c0-f05242681d62 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.183652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb170c-c6c7-4cdf-82c0-f05242681d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.183652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb170c-c6c7-4cdf-82c0-f05242681d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.238462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3bfc-6422-4eaa-9db8-867586703960 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.240716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:22.253274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb170c-c6c7-4cdf-82c0-f05242681d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.254751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb170c-c6c7-4cdf-82c0-f05242681d62 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.272310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e29de-0289-4abe-bba6-12b4de9ca0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.272957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e29de-0289-4abe-bba6-12b4de9ca0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.273241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e29de-0289-4abe-bba6-12b4de9ca0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.273552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e29de-0289-4abe-bba6-12b4de9ca0f7 None admin] PATH_INFO: `/v3/users/4fa4130cd11045fca9174faec75a53cd` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.274719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e29de-0289-4abe-bba6-12b4de9ca0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=4fa4130cd11045fca9174faec75a53cd)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.276158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e29de-0289-4abe-bba6-12b4de9ca0f7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.277794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 55/118] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:22 2022] GET /identity/v3/users/4fa4130cd11045fca9174faec75a53cd => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:22.278623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e29de-0289-4abe-bba6-12b4de9ca0f7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.350883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 64/119] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:22.352129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9634a-84ed-4061-a2ce-54b367ffd940 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.352931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9634a-84ed-4061-a2ce-54b367ffd940 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.353209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9634a-84ed-4061-a2ce-54b367ffd940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.370463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-aba9634a-84ed-4061-a2ce-54b367ffd940 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:22.371647 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-aba9634a-84ed-4061-a2ce-54b367ffd940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:22.380893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e29de-0289-4abe-bba6-12b4de9ca0f7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.395962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:22.414302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399565aa-a85f-4dd0-b43a-9d2e4cd7c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.415488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399565aa-a85f-4dd0-b43a-9d2e4cd7c05f None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.415775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399565aa-a85f-4dd0-b43a-9d2e4cd7c05f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.416058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399565aa-a85f-4dd0-b43a-9d2e4cd7c05f None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/users/4fa4130cd11045fca9174faec75a53cd/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.418023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399565aa-a85f-4dd0-b43a-9d2e4cd7c05f None admin] RBAC: Authorizing `identity:create_grant(project_id=7401ba8e38da408d810d1c3f4f7334d5, user_id=4fa4130cd11045fca9174faec75a53cd, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.419481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399565aa-a85f-4dd0-b43a-9d2e4cd7c05f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.434772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 56/120] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:22 2022] PUT /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/users/4fa4130cd11045fca9174faec75a53cd/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:22.435459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399565aa-a85f-4dd0-b43a-9d2e4cd7c05f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.441709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 65/121] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:22.443028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c924d-7034-494d-bdf7-44d72b2e8b78 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.443320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c924d-7034-494d-bdf7-44d72b2e8b78 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.443602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c924d-7034-494d-bdf7-44d72b2e8b78 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.449109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 66/122] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:22.449109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c924d-7034-494d-bdf7-44d72b2e8b78 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.490672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:22.577067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399565aa-a85f-4dd0-b43a-9d2e4cd7c05f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.579208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c924d-7034-494d-bdf7-44d72b2e8b78 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.620030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac11de7-717b-4070-99c1-e32b0b290d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.620684 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac11de7-717b-4070-99c1-e32b0b290d82 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.620969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac11de7-717b-4070-99c1-e32b0b290d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.621298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac11de7-717b-4070-99c1-e32b0b290d82 None admin] PATH_INFO: `/v3/users/525c51ec9f124dbfa5960c298384d18f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.622500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac11de7-717b-4070-99c1-e32b0b290d82 None admin] RBAC: Authorizing `identity:get_user(user_id=525c51ec9f124dbfa5960c298384d18f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.623946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac11de7-717b-4070-99c1-e32b0b290d82 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.625574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 57/123] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:22 2022] GET /identity/v3/users/525c51ec9f124dbfa5960c298384d18f => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:22.626339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac11de7-717b-4070-99c1-e32b0b290d82 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.627088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bef1cd-1e67-4180-87f4-083f5db4eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.627916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bef1cd-1e67-4180-87f4-083f5db4eaaf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.628385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bef1cd-1e67-4180-87f4-083f5db4eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.628825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bef1cd-1e67-4180-87f4-083f5db4eaaf None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.631197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bef1cd-1e67-4180-87f4-083f5db4eaaf None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.632675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bef1cd-1e67-4180-87f4-083f5db4eaaf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.634564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 67/124] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:22 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:22.637088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53a5e4-3428-4dd0-860c-a6373f185a29 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.637088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53a5e4-3428-4dd0-860c-a6373f185a29 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.637088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53a5e4-3428-4dd0-860c-a6373f185a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.656366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3b53a5e4-3428-4dd0-860c-a6373f185a29 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:22.657590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3b53a5e4-3428-4dd0-860c-a6373f185a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:22.679353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:22.728631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 68/125] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:22.729436 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53a5e4-3428-4dd0-860c-a6373f185a29 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.738667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:22.742809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac11de7-717b-4070-99c1-e32b0b290d82 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.779501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe18fb-5101-4590-b08e-39ae9fa40b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.780299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe18fb-5101-4590-b08e-39ae9fa40b9c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.780486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe18fb-5101-4590-b08e-39ae9fa40b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.780771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe18fb-5101-4590-b08e-39ae9fa40b9c None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.782225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe18fb-5101-4590-b08e-39ae9fa40b9c None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.783678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe18fb-5101-4590-b08e-39ae9fa40b9c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.785535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 58/126] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:22 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:22.791400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe18fb-5101-4590-b08e-39ae9fa40b9c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.841765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53a5e4-3428-4dd0-860c-a6373f185a29 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.877541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05e3a8-86e3-4a6a-a079-260c829b14c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.878223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05e3a8-86e3-4a6a-a079-260c829b14c5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.878487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05e3a8-86e3-4a6a-a079-260c829b14c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.878765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05e3a8-86e3-4a6a-a079-260c829b14c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.879909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05e3a8-86e3-4a6a-a079-260c829b14c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.881371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05e3a8-86e3-4a6a-a079-260c829b14c5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.888272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 69/127] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:22.889125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05e3a8-86e3-4a6a-a079-260c829b14c5 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.900474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe18fb-5101-4590-b08e-39ae9fa40b9c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:22.915026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:22.936863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee650f-9019-469d-92f4-45f2e4026c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:22.937541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee650f-9019-469d-92f4-45f2e4026c12 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:22.937832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee650f-9019-469d-92f4-45f2e4026c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:22.938112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee650f-9019-469d-92f4-45f2e4026c12 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:22.939273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee650f-9019-469d-92f4-45f2e4026c12 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:22.940735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee650f-9019-469d-92f4-45f2e4026c12 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:22.942432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 59/128] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:22 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:22.943200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee650f-9019-469d-92f4-45f2e4026c12 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:22.981672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:23.004134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05e3a8-86e3-4a6a-a079-260c829b14c5 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:23.041694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee6fe-5e4d-4197-aa15-5c5591df73e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:23.042605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee6fe-5e4d-4197-aa15-5c5591df73e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:23.042901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee6fe-5e4d-4197-aa15-5c5591df73e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:23.043176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ee6fe-5e4d-4197-aa15-5c5591df73e5 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/users/4fa4130cd11045fca9174faec75a53cd/roles/9bd0594bb1684b5eaa192f6669a7fc36` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:23.045443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ee6fe-5e4d-4197-aa15-5c5591df73e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7401ba8e38da408d810d1c3f4f7334d5, user_id=4fa4130cd11045fca9174faec75a53cd, role_id=9bd0594bb1684b5eaa192f6669a7fc36)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:23.046881 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ee6fe-5e4d-4197-aa15-5c5591df73e5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:23.052459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee650f-9019-469d-92f4-45f2e4026c12 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:23.073361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 70/129] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:22 2022] PUT /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/users/4fa4130cd11045fca9174faec75a53cd/roles/9bd0594bb1684b5eaa192f6669a7fc36 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:23.073361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee6fe-5e4d-4197-aa15-5c5591df73e5 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:23.090626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6939921-c399-4d58-b9bb-ede221522d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:23.091348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6939921-c399-4d58-b9bb-ede221522d32 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:23.091684 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6939921-c399-4d58-b9bb-ede221522d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:23.091957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6939921-c399-4d58-b9bb-ede221522d32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:23.109702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6939921-c399-4d58-b9bb-ede221522d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f6939921-c399-4d58-b9bb-ede221522d32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:23.116001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:23.117085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:23.118115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:23.121491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 60/130] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:23.123346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6939921-c399-4d58-b9bb-ede221522d32 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:23.186583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:23.209438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ee6fe-5e4d-4197-aa15-5c5591df73e5 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:23.234125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:23.240733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6939921-c399-4d58-b9bb-ede221522d32 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:23.275574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02e8a9-cbc6-4161-af34-545040d8ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:23.276481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02e8a9-cbc6-4161-af34-545040d8ccf9 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:23.276481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02e8a9-cbc6-4161-af34-545040d8ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:23.276724 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02e8a9-cbc6-4161-af34-545040d8ccf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:23.277905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02e8a9-cbc6-4161-af34-545040d8ccf9 None admin] RBAC: Adding query filter params (role.id=127662cbe07e4d75a303f7c70bca2244, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5, user.id=84eb3314d4ce476a9b76302290d68077) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:23.277905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02e8a9-cbc6-4161-af34-545040d8ccf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:23.279300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02e8a9-cbc6-4161-af34-545040d8ccf9 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:23.286098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 71/131] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:23 2022] GET /identity/v3/role_assignments?user.id=84eb3314d4ce476a9b76302290d68077&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=127662cbe07e4d75a303f7c70bca2244 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:23.287349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02e8a9-cbc6-4161-af34-545040d8ccf9 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:23.294668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f305b13-2968-4c7c-8cf0-f70824abf603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:23.295296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f305b13-2968-4c7c-8cf0-f70824abf603 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:23.295577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f305b13-2968-4c7c-8cf0-f70824abf603 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:23.296376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f305b13-2968-4c7c-8cf0-f70824abf603 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:23.297088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f305b13-2968-4c7c-8cf0-f70824abf603 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:23.298636 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f305b13-2968-4c7c-8cf0-f70824abf603 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:23.334837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 61/132] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:22:23 2022] POST /identity/v3/projects => generated 302 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:23.335740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f305b13-2968-4c7c-8cf0-f70824abf603 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:23.450178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02e8a9-cbc6-4161-af34-545040d8ccf9 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:23.507517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f305b13-2968-4c7c-8cf0-f70824abf603 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:23.508411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b292c-5980-4bb6-851e-28077f7741e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:23.510456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b292c-5980-4bb6-851e-28077f7741e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:23.511980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b292c-5980-4bb6-851e-28077f7741e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:23.512481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b292c-5980-4bb6-851e-28077f7741e3 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/users/525c51ec9f124dbfa5960c298384d18f/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:23.514990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b292c-5980-4bb6-851e-28077f7741e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7401ba8e38da408d810d1c3f4f7334d5, user_id=525c51ec9f124dbfa5960c298384d18f, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:23.516746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b292c-5980-4bb6-851e-28077f7741e3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:23.534561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 72/133] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:23 2022] PUT /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/users/525c51ec9f124dbfa5960c298384d18f/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:23.566701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae5c03-d040-4166-9941-aa8adbcb49c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:23.568123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae5c03-d040-4166-9941-aa8adbcb49c6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:23.568622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae5c03-d040-4166-9941-aa8adbcb49c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:23.569036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae5c03-d040-4166-9941-aa8adbcb49c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:23.570033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae5c03-d040-4166-9941-aa8adbcb49c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:23.570485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae5c03-d040-4166-9941-aa8adbcb49c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:23.572761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae5c03-d040-4166-9941-aa8adbcb49c6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:23.584201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 62/134] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:23.590329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b292c-5980-4bb6-851e-28077f7741e3 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:23.604939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:23.709251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b292c-5980-4bb6-851e-28077f7741e3 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:23.747134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48236f-3de1-4988-beda-d9bad6c45c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:23.747781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48236f-3de1-4988-beda-d9bad6c45c83 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:23.748073 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48236f-3de1-4988-beda-d9bad6c45c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:23.748352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48236f-3de1-4988-beda-d9bad6c45c83 None admin] PATH_INFO: `/v3/users/4fa4130cd11045fca9174faec75a53cd` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:23.749564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48236f-3de1-4988-beda-d9bad6c45c83 None admin] RBAC: Authorizing `identity:get_user(user_id=4fa4130cd11045fca9174faec75a53cd)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:23.751009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48236f-3de1-4988-beda-d9bad6c45c83 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:23.752693 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 73/135] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:23 2022] GET /identity/v3/users/4fa4130cd11045fca9174faec75a53cd => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:23.758469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae5c03-d040-4166-9941-aa8adbcb49c6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:23.772087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:23.869921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae5c03-d040-4166-9941-aa8adbcb49c6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:23.905312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7bb74-d5e4-44e4-936a-12e154fd4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:23.905995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7bb74-d5e4-44e4-936a-12e154fd4971 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:23.906576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7bb74-d5e4-44e4-936a-12e154fd4971 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:23.906854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7bb74-d5e4-44e4-936a-12e154fd4971 None admin] PATH_INFO: `/v3/projects/857ac3a4e4414c25b406a2ff44e42f35` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:23.908026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7bb74-d5e4-44e4-936a-12e154fd4971 None admin] RBAC: Authorizing `identity:get_project(project_id=857ac3a4e4414c25b406a2ff44e42f35)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:23.909525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7bb74-d5e4-44e4-936a-12e154fd4971 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:23.911188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 63/136] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:23 2022] GET /identity/v3/projects/857ac3a4e4414c25b406a2ff44e42f35 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:23.917767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48236f-3de1-4988-beda-d9bad6c45c83 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:24.008625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:24.034772 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48236f-3de1-4988-beda-d9bad6c45c83 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:24.082032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a3c7f-7bf6-405a-8836-f84d835b342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:24.082806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a3c7f-7bf6-405a-8836-f84d835b342d None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.083160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a3c7f-7bf6-405a-8836-f84d835b342d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.083509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a3c7f-7bf6-405a-8836-f84d835b342d None admin] PATH_INFO: `/v3/projects/857ac3a4e4414c25b406a2ff44e42f35/users/4fa4130cd11045fca9174faec75a53cd/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.085616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a3c7f-7bf6-405a-8836-f84d835b342d None admin] RBAC: Authorizing `identity:create_grant(project_id=857ac3a4e4414c25b406a2ff44e42f35, user_id=4fa4130cd11045fca9174faec75a53cd, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:24.087748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a3c7f-7bf6-405a-8836-f84d835b342d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:24.110695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 74/137] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:23 2022] PUT /identity/v3/projects/857ac3a4e4414c25b406a2ff44e42f35/users/4fa4130cd11045fca9174faec75a53cd/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:24.835706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a67a49-9871-4618-bc11-0cd564c09db7 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.836044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a67a49-9871-4618-bc11-0cd564c09db7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.836244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a67a49-9871-4618-bc11-0cd564c09db7 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.837992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 64/138] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:24.842767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bc655-a34e-4073-8ae6-e354f588f54d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:24.843062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bc655-a34e-4073-8ae6-e354f588f54d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:24.843345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bc655-a34e-4073-8ae6-e354f588f54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:24.867287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-857bc655-a34e-4073-8ae6-e354f588f54d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:24.869025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-857bc655-a34e-4073-8ae6-e354f588f54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:24.955818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 75/139] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:24.989977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a67a49-9871-4618-bc11-0cd564c09db7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.079921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:25.104818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a67a49-9871-4618-bc11-0cd564c09db7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:25.142812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972dc81-d2bd-4ffe-8966-3720034d9721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:25.143463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972dc81-d2bd-4ffe-8966-3720034d9721 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:25.143743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972dc81-d2bd-4ffe-8966-3720034d9721 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:25.144020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972dc81-d2bd-4ffe-8966-3720034d9721 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:25.154733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972dc81-d2bd-4ffe-8966-3720034d9721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4972dc81-d2bd-4ffe-8966-3720034d9721 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:25.160527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:25.161418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:25.162212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 65/140] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:25.170327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bc655-a34e-4073-8ae6-e354f588f54d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.252498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:25.294708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bc655-a34e-4073-8ae6-e354f588f54d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:25.330444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c32dc8-cba6-426d-a0e1-2434d69f8301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:25.331116 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c32dc8-cba6-426d-a0e1-2434d69f8301 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:25.331405 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c32dc8-cba6-426d-a0e1-2434d69f8301 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:25.331682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c32dc8-cba6-426d-a0e1-2434d69f8301 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:25.332406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c32dc8-cba6-426d-a0e1-2434d69f8301 None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:25.332710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c32dc8-cba6-426d-a0e1-2434d69f8301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:25.334153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c32dc8-cba6-426d-a0e1-2434d69f8301 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:25.343020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 76/141] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:25.350727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972dc81-d2bd-4ffe-8966-3720034d9721 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.465930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972dc81-d2bd-4ffe-8966-3720034d9721 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:25.501939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2073f57-f54f-40e6-9771-e04a1e910bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:25.502588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2073f57-f54f-40e6-9771-e04a1e910bee None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:25.502874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2073f57-f54f-40e6-9771-e04a1e910bee None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:25.503157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2073f57-f54f-40e6-9771-e04a1e910bee None admin] PATH_INFO: `/v3/users/4fa4130cd11045fca9174faec75a53cd` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:25.504318 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2073f57-f54f-40e6-9771-e04a1e910bee None admin] RBAC: Authorizing `identity:get_user(user_id=4fa4130cd11045fca9174faec75a53cd)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:25.505998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2073f57-f54f-40e6-9771-e04a1e910bee None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:25.507949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 66/142] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:25 2022] GET /identity/v3/users/4fa4130cd11045fca9174faec75a53cd => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:25.515902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c32dc8-cba6-426d-a0e1-2434d69f8301 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.641816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c32dc8-cba6-426d-a0e1-2434d69f8301 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:25.681978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:25.690319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eaebc1-d0db-474d-bcaf-e021c7cd59de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:25.691138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaebc1-d0db-474d-bcaf-e021c7cd59de None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:25.691535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaebc1-d0db-474d-bcaf-e021c7cd59de None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:25.694520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaebc1-d0db-474d-bcaf-e021c7cd59de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:25.780804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eaebc1-d0db-474d-bcaf-e021c7cd59de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:25.782480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eaebc1-d0db-474d-bcaf-e021c7cd59de None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:25.901797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 77/143] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:25.907255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2073f57-f54f-40e6-9771-e04a1e910bee None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:25.922439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:26.030658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2073f57-f54f-40e6-9771-e04a1e910bee None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:26.070026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52b47d-0ae1-4066-8059-6e4f55edd0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:26.070603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52b47d-0ae1-4066-8059-6e4f55edd0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.071400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52b47d-0ae1-4066-8059-6e4f55edd0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.071699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52b47d-0ae1-4066-8059-6e4f55edd0f7 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.076935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52b47d-0ae1-4066-8059-6e4f55edd0f7 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:26.078507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52b47d-0ae1-4066-8059-6e4f55edd0f7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:26.080646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 67/144] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:25 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:26.086438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eaebc1-d0db-474d-bcaf-e021c7cd59de None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:26.130446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:26.234287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eaebc1-d0db-474d-bcaf-e021c7cd59de None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:26.286244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f52fbd-5140-4872-9746-9f52cc260537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:26.286870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f52fbd-5140-4872-9746-9f52cc260537 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.287153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f52fbd-5140-4872-9746-9f52cc260537 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.287432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f52fbd-5140-4872-9746-9f52cc260537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.288221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f52fbd-5140-4872-9746-9f52cc260537 None admin] RBAC: Adding query filter params (role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5, user.id=4fa4130cd11045fca9174faec75a53cd) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:26.288533 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f52fbd-5140-4872-9746-9f52cc260537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:26.290033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f52fbd-5140-4872-9746-9f52cc260537 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:26.302092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 78/145] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:26 2022] GET /identity/v3/role_assignments?user.id=4fa4130cd11045fca9174faec75a53cd&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=2fcd0ee644864d67833017de80ba1627 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:26.352670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508c1f6-1803-49ba-bc18-a91eb2999c80 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.352852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508c1f6-1803-49ba-bc18-a91eb2999c80 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.353133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508c1f6-1803-49ba-bc18-a91eb2999c80 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.354719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 68/146] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:26.360058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cef9c-682e-4f8f-87fe-8279d94923b5 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.360350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cef9c-682e-4f8f-87fe-8279d94923b5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.360629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cef9c-682e-4f8f-87fe-8279d94923b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.380168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ea3cef9c-682e-4f8f-87fe-8279d94923b5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:26.381399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ea3cef9c-682e-4f8f-87fe-8279d94923b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:26.477087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 79/147] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:26.511851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508c1f6-1803-49ba-bc18-a91eb2999c80 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:26.617601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:26.631587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc0141-3fb0-4d22-b126-5aca62cd8256 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.631761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc0141-3fb0-4d22-b126-5aca62cd8256 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.632031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc0141-3fb0-4d22-b126-5aca62cd8256 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.633524 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 80/148] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:26.639345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06236f-ce1c-4baf-a9cf-fe96ceac8a51 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.639638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06236f-ce1c-4baf-a9cf-fe96ceac8a51 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.639921 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06236f-ce1c-4baf-a9cf-fe96ceac8a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.661675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ae06236f-ce1c-4baf-a9cf-fe96ceac8a51 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:26.663223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ae06236f-ce1c-4baf-a9cf-fe96ceac8a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:26.665672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508c1f6-1803-49ba-bc18-a91eb2999c80 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:26.696098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:26.734038 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa5f35-98e8-46e8-b923-bdc17abd3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:26.735074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa5f35-98e8-46e8-b923-bdc17abd3994 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.735455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa5f35-98e8-46e8-b923-bdc17abd3994 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.735836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa5f35-98e8-46e8-b923-bdc17abd3994 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.741209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 81/149] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:26.754183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa5f35-98e8-46e8-b923-bdc17abd3994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-89aa5f35-98e8-46e8-b923-bdc17abd3994 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:26.760866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:26.761988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:26.762745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 69/150] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:26.769621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06236f-ce1c-4baf-a9cf-fe96ceac8a51 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:26.785119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa5f35-98e8-46e8-b923-bdc17abd3994 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:26.910773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06236f-ce1c-4baf-a9cf-fe96ceac8a51 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:26.926465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa5f35-98e8-46e8-b923-bdc17abd3994 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:26.950314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3937cb-aeee-4888-bc00-dcef2380323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:26.950963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3937cb-aeee-4888-bc00-dcef2380323a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.951245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3937cb-aeee-4888-bc00-dcef2380323a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.951519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3937cb-aeee-4888-bc00-dcef2380323a None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.952235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3937cb-aeee-4888-bc00-dcef2380323a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:26.952539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3937cb-aeee-4888-bc00-dcef2380323a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:26.953978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3937cb-aeee-4888-bc00-dcef2380323a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:26.963398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 82/151] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:26.964433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b79da-05cb-4b89-bfdb-79f358e39f02 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.964717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b79da-05cb-4b89-bfdb-79f358e39f02 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.964997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b79da-05cb-4b89-bfdb-79f358e39f02 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.966257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 83/152] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:26.967335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367fe0d-d8ea-4e22-b43a-97b8ab7c6fe2 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.967617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367fe0d-d8ea-4e22-b43a-97b8ab7c6fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.967888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367fe0d-d8ea-4e22-b43a-97b8ab7c6fe2 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.969832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 84/153] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:26.969832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367fe0d-d8ea-4e22-b43a-97b8ab7c6fe2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:26.979376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2646fd-5978-420f-b190-e45914e1cc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:26.980037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2646fd-5978-420f-b190-e45914e1cc7a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:26.980321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2646fd-5978-420f-b190-e45914e1cc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:26.980599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2646fd-5978-420f-b190-e45914e1cc7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:26.982999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:26.989438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:26.994309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2646fd-5978-420f-b190-e45914e1cc7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-da2646fd-5978-420f-b190-e45914e1cc7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:26.999957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:27.005768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 70/154] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:27.006793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec37cc-7f2c-41c7-9b81-533edc6d8a4c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.007842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec37cc-7f2c-41c7-9b81-533edc6d8a4c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.007842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec37cc-7f2c-41c7-9b81-533edc6d8a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.023462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-76ec37cc-7f2c-41c7-9b81-533edc6d8a4c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:27.025171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-76ec37cc-7f2c-41c7-9b81-533edc6d8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:27.095099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367fe0d-d8ea-4e22-b43a-97b8ab7c6fe2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.099924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 71/155] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:27.101885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad700de9-8fa7-432e-8643-da6f24c2fc09 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.103017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad700de9-8fa7-432e-8643-da6f24c2fc09 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.103661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad700de9-8fa7-432e-8643-da6f24c2fc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.122069 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ad700de9-8fa7-432e-8643-da6f24c2fc09 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:27.123371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ad700de9-8fa7-432e-8643-da6f24c2fc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:27.140873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea2935-4fcb-4f05-b36b-2645877b6ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.141544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea2935-4fcb-4f05-b36b-2645877b6ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.141832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea2935-4fcb-4f05-b36b-2645877b6ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.142102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea2935-4fcb-4f05-b36b-2645877b6ac0 None admin] PATH_INFO: `/v3/users/84eb3314d4ce476a9b76302290d68077` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.143269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea2935-4fcb-4f05-b36b-2645877b6ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=84eb3314d4ce476a9b76302290d68077)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:27.144775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea2935-4fcb-4f05-b36b-2645877b6ac0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:27.146432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 85/156] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:26 2022] GET /identity/v3/users/84eb3314d4ce476a9b76302290d68077 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:27.147190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea2935-4fcb-4f05-b36b-2645877b6ac0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:27.191143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 72/157] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:27.194352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad700de9-8fa7-432e-8643-da6f24c2fc09 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:27.229578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:27.247394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea2935-4fcb-4f05-b36b-2645877b6ac0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.250203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:27.280848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc1f70-83f0-45f0-9aec-5b6fdcc13886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.281761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc1f70-83f0-45f0-9aec-5b6fdcc13886 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.282040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc1f70-83f0-45f0-9aec-5b6fdcc13886 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.282463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc1f70-83f0-45f0-9aec-5b6fdcc13886 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.283014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc1f70-83f0-45f0-9aec-5b6fdcc13886 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:27.283317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc1f70-83f0-45f0-9aec-5b6fdcc13886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:27.284686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc1f70-83f0-45f0-9aec-5b6fdcc13886 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:27.293278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 86/158] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:27.297817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666854c8-198b-4a6b-bd52-2333b1817cd8 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.297817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666854c8-198b-4a6b-bd52-2333b1817cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.297817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666854c8-198b-4a6b-bd52-2333b1817cd8 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.297817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 87/159] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:27.297817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666854c8-198b-4a6b-bd52-2333b1817cd8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:27.303217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad700de9-8fa7-432e-8643-da6f24c2fc09 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.337971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ceeef2-ebc0-4e7e-b7ba-7e26fd049b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.338610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ceeef2-ebc0-4e7e-b7ba-7e26fd049b09 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.338889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ceeef2-ebc0-4e7e-b7ba-7e26fd049b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.339166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ceeef2-ebc0-4e7e-b7ba-7e26fd049b09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.340310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ceeef2-ebc0-4e7e-b7ba-7e26fd049b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:27.341794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ceeef2-ebc0-4e7e-b7ba-7e26fd049b09 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:27.343374 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 73/160] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:27.345971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ceeef2-ebc0-4e7e-b7ba-7e26fd049b09 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:27.397708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666854c8-198b-4a6b-bd52-2333b1817cd8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.430961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e639-e2a6-4758-abc8-5ccdf9d5abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.432002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e639-e2a6-4758-abc8-5ccdf9d5abf9 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.432290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e639-e2a6-4758-abc8-5ccdf9d5abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.432563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e639-e2a6-4758-abc8-5ccdf9d5abf9 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.433735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6e639-e2a6-4758-abc8-5ccdf9d5abf9 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:27.435158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6e639-e2a6-4758-abc8-5ccdf9d5abf9 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:27.436812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 88/161] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:27 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:27.436812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e639-e2a6-4758-abc8-5ccdf9d5abf9 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:27.448718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ceeef2-ebc0-4e7e-b7ba-7e26fd049b09 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.452163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:27.472504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:27.483846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be214140-8ea2-43f3-8fdb-1e7bc67be1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.484479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be214140-8ea2-43f3-8fdb-1e7bc67be1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.484761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be214140-8ea2-43f3-8fdb-1e7bc67be1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.485038 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be214140-8ea2-43f3-8fdb-1e7bc67be1f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.494950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be214140-8ea2-43f3-8fdb-1e7bc67be1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-be214140-8ea2-43f3-8fdb-1e7bc67be1f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:27.499854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:27.500839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:27.501621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 74/162] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:27.502256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0da40-569d-4db5-b4dd-faf6265a8d70 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.502432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0da40-569d-4db5-b4dd-faf6265a8d70 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.502743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0da40-569d-4db5-b4dd-faf6265a8d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.520370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5ac0da40-569d-4db5-b4dd-faf6265a8d70 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:27.521600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5ac0da40-569d-4db5-b4dd-faf6265a8d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:27.542220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e639-e2a6-4758-abc8-5ccdf9d5abf9 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.577378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96eaf3b-88ca-4d46-909d-3b86a410251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.578021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eaf3b-88ca-4d46-909d-3b86a410251d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.578302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eaf3b-88ca-4d46-909d-3b86a410251d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.578574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eaf3b-88ca-4d46-909d-3b86a410251d None admin] PATH_INFO: `/v3/users/4fa4130cd11045fca9174faec75a53cd` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.579738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96eaf3b-88ca-4d46-909d-3b86a410251d None admin] RBAC: Authorizing `identity:get_user(user_id=4fa4130cd11045fca9174faec75a53cd)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:27.581176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96eaf3b-88ca-4d46-909d-3b86a410251d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:27.582822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 89/163] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:27 2022] GET /identity/v3/users/4fa4130cd11045fca9174faec75a53cd => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:27.586147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96eaf3b-88ca-4d46-909d-3b86a410251d None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:27.590742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 75/164] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:27.601312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0da40-569d-4db5-b4dd-faf6265a8d70 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:27.667494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:27.686080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96eaf3b-88ca-4d46-909d-3b86a410251d None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.697418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0da40-569d-4db5-b4dd-faf6265a8d70 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.709805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:27.719299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d618c-a1b6-47e4-8fba-315ae35008ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.719916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d618c-a1b6-47e4-8fba-315ae35008ab None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.720200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d618c-a1b6-47e4-8fba-315ae35008ab None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.720473 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d618c-a1b6-47e4-8fba-315ae35008ab None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.721155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d618c-a1b6-47e4-8fba-315ae35008ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:27.722618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d618c-a1b6-47e4-8fba-315ae35008ab None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:27.731056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace8dd-a165-4996-a447-cfe488afb464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.731775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace8dd-a165-4996-a447-cfe488afb464 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.731993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace8dd-a165-4996-a447-cfe488afb464 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.732272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ace8dd-a165-4996-a447-cfe488afb464 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/users/84eb3314d4ce476a9b76302290d68077/roles/127662cbe07e4d75a303f7c70bca2244` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.734233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ace8dd-a165-4996-a447-cfe488afb464 None admin] RBAC: Authorizing `identity:create_grant(project_id=7401ba8e38da408d810d1c3f4f7334d5, user_id=84eb3314d4ce476a9b76302290d68077, role_id=127662cbe07e4d75a303f7c70bca2244)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:27.735669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ace8dd-a165-4996-a447-cfe488afb464 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:27.744044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 90/165] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:22:27 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:27.744878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d618c-a1b6-47e4-8fba-315ae35008ab None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:27.769365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 76/166] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:27 2022] PUT /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/users/84eb3314d4ce476a9b76302290d68077/roles/127662cbe07e4d75a303f7c70bca2244 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:27.769365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace8dd-a165-4996-a447-cfe488afb464 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:27.893515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ace8dd-a165-4996-a447-cfe488afb464 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.909847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d618c-a1b6-47e4-8fba-315ae35008ab None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:27.940156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd552ecf-7dc4-46a5-8374-30ec3a4883b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.940789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd552ecf-7dc4-46a5-8374-30ec3a4883b9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.941073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd552ecf-7dc4-46a5-8374-30ec3a4883b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.941395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd552ecf-7dc4-46a5-8374-30ec3a4883b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.955497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f6bf9-691a-4800-bfa5-4703ef6d3855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:27.955497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f6bf9-691a-4800-bfa5-4703ef6d3855 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:27.955768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f6bf9-691a-4800-bfa5-4703ef6d3855 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:27.955966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f6bf9-691a-4800-bfa5-4703ef6d3855 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:27.956678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f6bf9-691a-4800-bfa5-4703ef6d3855 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:27.958184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f6bf9-691a-4800-bfa5-4703ef6d3855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:27.958525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f6bf9-691a-4800-bfa5-4703ef6d3855 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:27.960952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:27.968957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 91/167] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:27.969842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f6bf9-691a-4800-bfa5-4703ef6d3855 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.004856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.046715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd552ecf-7dc4-46a5-8374-30ec3a4883b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.048337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd552ecf-7dc4-46a5-8374-30ec3a4883b9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.091020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f6bf9-691a-4800-bfa5-4703ef6d3855 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.135781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c2e81-772b-4ef9-b0e7-ea3d6f0d9a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.136509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c2e81-772b-4ef9-b0e7-ea3d6f0d9a66 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.136706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c2e81-772b-4ef9-b0e7-ea3d6f0d9a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.136979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c2e81-772b-4ef9-b0e7-ea3d6f0d9a66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.150674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c2e81-772b-4ef9-b0e7-ea3d6f0d9a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-684c2e81-772b-4ef9-b0e7-ea3d6f0d9a66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:28.155942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:28.157150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:28.157988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 92/168] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:28.158621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c2e81-772b-4ef9-b0e7-ea3d6f0d9a66 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.185361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 77/169] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:28.186844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd552ecf-7dc4-46a5-8374-30ec3a4883b9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.230269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.271571 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.286923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c2e81-772b-4ef9-b0e7-ea3d6f0d9a66 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.311866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd552ecf-7dc4-46a5-8374-30ec3a4883b9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.333829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd7a9a-da24-47f5-bb8c-91856c3e42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.335079 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd7a9a-da24-47f5-bb8c-91856c3e42ed None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.335815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd7a9a-da24-47f5-bb8c-91856c3e42ed None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.336551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd7a9a-da24-47f5-bb8c-91856c3e42ed None admin] PATH_INFO: `/v3/users/525c51ec9f124dbfa5960c298384d18f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.339006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd7a9a-da24-47f5-bb8c-91856c3e42ed None admin] RBAC: Authorizing `identity:get_user(user_id=525c51ec9f124dbfa5960c298384d18f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.341236 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd7a9a-da24-47f5-bb8c-91856c3e42ed None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.344020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 93/170] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/users/525c51ec9f124dbfa5960c298384d18f => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:28.345501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd7a9a-da24-47f5-bb8c-91856c3e42ed None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.357868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448d299-c94b-4ea5-a920-085d6c7358b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.358262 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d299-c94b-4ea5-a920-085d6c7358b2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.358547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d299-c94b-4ea5-a920-085d6c7358b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.358825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d299-c94b-4ea5-a920-085d6c7358b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.359672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d299-c94b-4ea5-a920-085d6c7358b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:28.359981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d299-c94b-4ea5-a920-085d6c7358b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.361411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448d299-c94b-4ea5-a920-085d6c7358b2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.373200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 78/171] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:28.374245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448d299-c94b-4ea5-a920-085d6c7358b2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.485129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd7a9a-da24-47f5-bb8c-91856c3e42ed None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.514657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448d299-c94b-4ea5-a920-085d6c7358b2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.524865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.536889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73eac2a-e0fe-4b8c-be47-c4621560add3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.537896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73eac2a-e0fe-4b8c-be47-c4621560add3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.538370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73eac2a-e0fe-4b8c-be47-c4621560add3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.538831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73eac2a-e0fe-4b8c-be47-c4621560add3 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.541563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73eac2a-e0fe-4b8c-be47-c4621560add3 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.543627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73eac2a-e0fe-4b8c-be47-c4621560add3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.546303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 94/172] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:28.547516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73eac2a-e0fe-4b8c-be47-c4621560add3 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.565134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58959617-1eeb-4853-9f42-6bccc754fcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.565815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959617-1eeb-4853-9f42-6bccc754fcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.566099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959617-1eeb-4853-9f42-6bccc754fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.566372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959617-1eeb-4853-9f42-6bccc754fcc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.577020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.677126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58959617-1eeb-4853-9f42-6bccc754fcc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.680511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58959617-1eeb-4853-9f42-6bccc754fcc0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.700909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73eac2a-e0fe-4b8c-be47-c4621560add3 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.765639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b030379-4191-49c1-ba8b-9f06b3d399dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.766536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b030379-4191-49c1-ba8b-9f06b3d399dc None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.766964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b030379-4191-49c1-ba8b-9f06b3d399dc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.767379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b030379-4191-49c1-ba8b-9f06b3d399dc None admin] PATH_INFO: `/v3/users/4fa4130cd11045fca9174faec75a53cd` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.769460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b030379-4191-49c1-ba8b-9f06b3d399dc None admin] RBAC: Authorizing `identity:get_user(user_id=4fa4130cd11045fca9174faec75a53cd)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.771042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b030379-4191-49c1-ba8b-9f06b3d399dc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.774927 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 95/173] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/users/4fa4130cd11045fca9174faec75a53cd => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:28.777243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b030379-4191-49c1-ba8b-9f06b3d399dc None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.828095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 79/174] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:28.829157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58959617-1eeb-4853-9f42-6bccc754fcc0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:28.864275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.901712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:28.935451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58959617-1eeb-4853-9f42-6bccc754fcc0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.942846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b030379-4191-49c1-ba8b-9f06b3d399dc None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:28.972208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004fe0b-9ea5-4b94-966a-36382b763d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.972855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004fe0b-9ea5-4b94-966a-36382b763d27 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.973132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004fe0b-9ea5-4b94-966a-36382b763d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.973451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004fe0b-9ea5-4b94-966a-36382b763d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.978658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2c500-da61-4548-815f-f2309051fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:28.979280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2c500-da61-4548-815f-f2309051fc7c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:28.979555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2c500-da61-4548-815f-f2309051fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:28.979826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2c500-da61-4548-815f-f2309051fc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:28.980620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2c500-da61-4548-815f-f2309051fc7c None admin] RBAC: Adding query filter params (role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5, user.id=4fa4130cd11045fca9174faec75a53cd) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:28.980925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2c500-da61-4548-815f-f2309051fc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:28.982392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2c500-da61-4548-815f-f2309051fc7c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:28.988417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 96/175] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/role_assignments?user.id=4fa4130cd11045fca9174faec75a53cd&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:28.989346 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2c500-da61-4548-815f-f2309051fc7c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.048285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004fe0b-9ea5-4b94-966a-36382b763d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.049739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004fe0b-9ea5-4b94-966a-36382b763d27 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.086538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:29.105927 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2c500-da61-4548-815f-f2309051fc7c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.134167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:29.149982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc80fb-8feb-4816-ae45-0ca1958b486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.150779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc80fb-8feb-4816-ae45-0ca1958b486f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.150942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc80fb-8feb-4816-ae45-0ca1958b486f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.151216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc80fb-8feb-4816-ae45-0ca1958b486f None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.153659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc80fb-8feb-4816-ae45-0ca1958b486f None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.155168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc80fb-8feb-4816-ae45-0ca1958b486f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.157267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 97/176] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:29.165701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc80fb-8feb-4816-ae45-0ca1958b486f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.175077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 80/177] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:29.180570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004fe0b-9ea5-4b94-966a-36382b763d27 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.339988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc80fb-8feb-4816-ae45-0ca1958b486f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.355363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004fe0b-9ea5-4b94-966a-36382b763d27 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.380771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce7118-79d4-451a-90e0-a6016fe8e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.381412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce7118-79d4-451a-90e0-a6016fe8e6bb None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.381691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce7118-79d4-451a-90e0-a6016fe8e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.381961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce7118-79d4-451a-90e0-a6016fe8e6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.382743 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce7118-79d4-451a-90e0-a6016fe8e6bb None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5, user.id=525c51ec9f124dbfa5960c298384d18f) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:29.383047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce7118-79d4-451a-90e0-a6016fe8e6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.385107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce7118-79d4-451a-90e0-a6016fe8e6bb None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.392931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 98/178] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:29 2022] GET /identity/v3/role_assignments?user.id=525c51ec9f124dbfa5960c298384d18f&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=999cac3070e64b82b981258349005963 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:29.420568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686d8b8-1f8f-41fa-ba09-1c804cc2ac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.421227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686d8b8-1f8f-41fa-ba09-1c804cc2ac84 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.421558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686d8b8-1f8f-41fa-ba09-1c804cc2ac84 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.421893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686d8b8-1f8f-41fa-ba09-1c804cc2ac84 None admin] PATH_INFO: `/v3/projects/857ac3a4e4414c25b406a2ff44e42f35` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.423046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686d8b8-1f8f-41fa-ba09-1c804cc2ac84 None admin] RBAC: Authorizing `identity:get_project(project_id=857ac3a4e4414c25b406a2ff44e42f35)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.424511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686d8b8-1f8f-41fa-ba09-1c804cc2ac84 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.426439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 81/179] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:29 2022] GET /identity/v3/projects/857ac3a4e4414c25b406a2ff44e42f35 => generated 312 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:29.432924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce7118-79d4-451a-90e0-a6016fe8e6bb None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:29.496230 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:29.541428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce7118-79d4-451a-90e0-a6016fe8e6bb None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:29.578296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1b4b8-5d04-4835-9ef3-b1e4bbd34973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:29.578921 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1b4b8-5d04-4835-9ef3-b1e4bbd34973 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:29.579196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1b4b8-5d04-4835-9ef3-b1e4bbd34973 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:29.579464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1b4b8-5d04-4835-9ef3-b1e4bbd34973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:29.580255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1b4b8-5d04-4835-9ef3-b1e4bbd34973 None admin] RBAC: Adding query filter params (role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=857ac3a4e4414c25b406a2ff44e42f35, user.id=4fa4130cd11045fca9174faec75a53cd) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:29.580554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1b4b8-5d04-4835-9ef3-b1e4bbd34973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:29.582038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1b4b8-5d04-4835-9ef3-b1e4bbd34973 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:29.588694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 99/180] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:29 2022] GET /identity/v3/role_assignments?user.id=4fa4130cd11045fca9174faec75a53cd&scope.project.id=857ac3a4e4414c25b406a2ff44e42f35&role.id=2fcd0ee644864d67833017de80ba1627 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:30.505255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30320181-61bf-40f8-8ff9-4fd6a3a23b30 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:30.506292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30320181-61bf-40f8-8ff9-4fd6a3a23b30 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:30.506841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30320181-61bf-40f8-8ff9-4fd6a3a23b30 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:30.508732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 82/181] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:30.514157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2ae9d-6af1-496b-8a0a-d06a896855d7 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:30.514984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2ae9d-6af1-496b-8a0a-d06a896855d7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:30.515461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2ae9d-6af1-496b-8a0a-d06a896855d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:30.534489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-76f2ae9d-6af1-496b-8a0a-d06a896855d7 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:30.536006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-76f2ae9d-6af1-496b-8a0a-d06a896855d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:30.616188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 100/182] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:30.638954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30320181-61bf-40f8-8ff9-4fd6a3a23b30 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:30.642239 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:30.748991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee51a6-8201-423a-b98c-a696f7d8b08a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:30.749309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee51a6-8201-423a-b98c-a696f7d8b08a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:30.749571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee51a6-8201-423a-b98c-a696f7d8b08a None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:30.750927 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 101/183] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:30.751990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30320181-61bf-40f8-8ff9-4fd6a3a23b30 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:30.756582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1875e1-a297-4f2f-b4cf-d89cded4c44d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:30.756802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1875e1-a297-4f2f-b4cf-d89cded4c44d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:30.757071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1875e1-a297-4f2f-b4cf-d89cded4c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:30.775618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ed1875e1-a297-4f2f-b4cf-d89cded4c44d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:30.776810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ed1875e1-a297-4f2f-b4cf-d89cded4c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:30.794868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270b7f1-0a00-48c3-9418-45bae4af5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:30.795522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270b7f1-0a00-48c3-9418-45bae4af5d96 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:30.796174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270b7f1-0a00-48c3-9418-45bae4af5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:30.796444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270b7f1-0a00-48c3-9418-45bae4af5d96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:30.810774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270b7f1-0a00-48c3-9418-45bae4af5d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-5270b7f1-0a00-48c3-9418-45bae4af5d96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:30.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:30.817922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:30.818890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 83/184] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:30.826385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270b7f1-0a00-48c3-9418-45bae4af5d96 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:30.828509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:30.854638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 102/185] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:30.876794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1875e1-a297-4f2f-b4cf-d89cded4c44d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:30.899972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:30.944630 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270b7f1-0a00-48c3-9418-45bae4af5d96 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:30.978084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1875e1-a297-4f2f-b4cf-d89cded4c44d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:30.984286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7c40-0927-4601-a4cd-60de6e6428f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:30.985195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7c40-0927-4601-a4cd-60de6e6428f6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:30.985838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7c40-0927-4601-a4cd-60de6e6428f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:30.986314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7c40-0927-4601-a4cd-60de6e6428f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:30.987261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7c40-0927-4601-a4cd-60de6e6428f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:30.987867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7c40-0927-4601-a4cd-60de6e6428f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:30.989600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7c40-0927-4601-a4cd-60de6e6428f6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:31.003561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 84/186] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:31.005089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5dd35-bd78-49a8-82c7-867102b54901 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.005399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5dd35-bd78-49a8-82c7-867102b54901 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.005684 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5dd35-bd78-49a8-82c7-867102b54901 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.007139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 85/187] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:31.010716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5dd35-bd78-49a8-82c7-867102b54901 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.017855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc43fb-8376-4bb5-8516-6f9b9918cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.018624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc43fb-8376-4bb5-8516-6f9b9918cad6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.018901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc43fb-8376-4bb5-8516-6f9b9918cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.019166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc43fb-8376-4bb5-8516-6f9b9918cad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.030340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc43fb-8376-4bb5-8516-6f9b9918cad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-46fc43fb-8376-4bb5-8516-6f9b9918cad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:31.035483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:31.036389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:31.037194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 103/188] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:31.038638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2a24-845c-4319-9448-8053acb7ea9e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.038638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2a24-845c-4319-9448-8053acb7ea9e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.038638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2a24-845c-4319-9448-8053acb7ea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.056324 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-aefc2a24-845c-4319-9448-8053acb7ea9e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:31.057515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-aefc2a24-845c-4319-9448-8053acb7ea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:31.094423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:31.123696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5dd35-bd78-49a8-82c7-867102b54901 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.124680 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 104/189] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:31.125537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc2a24-845c-4319-9448-8053acb7ea9e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.147961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:31.160021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c04d-f686-406b-a96c-ada3f3bf11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.160664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c04d-f686-406b-a96c-ada3f3bf11d3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.160946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c04d-f686-406b-a96c-ada3f3bf11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.161220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c04d-f686-406b-a96c-ada3f3bf11d3 None admin] PATH_INFO: `/v3/users/84eb3314d4ce476a9b76302290d68077` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.162400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c04d-f686-406b-a96c-ada3f3bf11d3 None admin] RBAC: Authorizing `identity:get_user(user_id=84eb3314d4ce476a9b76302290d68077)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:31.163846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c04d-f686-406b-a96c-ada3f3bf11d3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:31.165513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 86/190] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/users/84eb3314d4ce476a9b76302290d68077 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:31.167922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1cf88-0656-4e42-86d4-023780db6054 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.168515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1cf88-0656-4e42-86d4-023780db6054 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.168888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1cf88-0656-4e42-86d4-023780db6054 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.170112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 87/191] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:31.174666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1cf88-0656-4e42-86d4-023780db6054 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.226025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc2a24-845c-4319-9448-8053acb7ea9e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.259078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0cbc6-62a7-4277-8e80-d2b1542eaad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.259625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0cbc6-62a7-4277-8e80-d2b1542eaad3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.259906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0cbc6-62a7-4277-8e80-d2b1542eaad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.260174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0cbc6-62a7-4277-8e80-d2b1542eaad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.260874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0cbc6-62a7-4277-8e80-d2b1542eaad3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:31.261169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0cbc6-62a7-4277-8e80-d2b1542eaad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:31.262554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0cbc6-62a7-4277-8e80-d2b1542eaad3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:31.270337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 105/192] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:31.270337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0cbc6-62a7-4277-8e80-d2b1542eaad3 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.275276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1cf88-0656-4e42-86d4-023780db6054 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.303887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:31.308638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132346c-789e-4acb-8652-2f28b2e84459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.309277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132346c-789e-4acb-8652-2f28b2e84459 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.309587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132346c-789e-4acb-8652-2f28b2e84459 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.309863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132346c-789e-4acb-8652-2f28b2e84459 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.320956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132346c-789e-4acb-8652-2f28b2e84459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-3132346c-789e-4acb-8652-2f28b2e84459 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:31.327454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:31.328421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:31.329223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 88/193] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:31.329912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef24f0-2c38-4f13-ada3-d0029bd7508a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.330384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef24f0-2c38-4f13-ada3-d0029bd7508a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.330384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef24f0-2c38-4f13-ada3-d0029bd7508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.347747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9aef24f0-2c38-4f13-ada3-d0029bd7508a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:31.348929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9aef24f0-2c38-4f13-ada3-d0029bd7508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:31.377675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0cbc6-62a7-4277-8e80-d2b1542eaad3 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.395819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:31.412063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ce94-0aef-4da8-a541-bb4b45b38982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.412706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ce94-0aef-4da8-a541-bb4b45b38982 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.412986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ce94-0aef-4da8-a541-bb4b45b38982 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.413262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ce94-0aef-4da8-a541-bb4b45b38982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.415802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 89/194] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:31.416517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef24f0-2c38-4f13-ada3-d0029bd7508a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.482482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6ce94-0aef-4da8-a541-bb4b45b38982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:31.483925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6ce94-0aef-4da8-a541-bb4b45b38982 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:31.516562 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:31.517828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef24f0-2c38-4f13-ada3-d0029bd7508a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.550942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3f26d-e73e-4557-be12-ed02547167c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.551576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3f26d-e73e-4557-be12-ed02547167c7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.551855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3f26d-e73e-4557-be12-ed02547167c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.552123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3f26d-e73e-4557-be12-ed02547167c7 None admin] PATH_INFO: `/v3/users/12640bef4ca9457eb9e8a4529b60d6db` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.565504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3f26d-e73e-4557-be12-ed02547167c7 None admin] RBAC: Authorizing `identity:get_user(user_id=12640bef4ca9457eb9e8a4529b60d6db)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:31.566949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3f26d-e73e-4557-be12-ed02547167c7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:31.568739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 90/195] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/users/12640bef4ca9457eb9e8a4529b60d6db => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:31.569435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3f26d-e73e-4557-be12-ed02547167c7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.591324 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 106/196] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:31.592169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ce94-0aef-4da8-a541-bb4b45b38982 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.615560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:31.673595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3f26d-e73e-4557-be12-ed02547167c7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.689667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ce94-0aef-4da8-a541-bb4b45b38982 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.707188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb951808-e556-4b6c-8262-05afda9bb2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.707798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb951808-e556-4b6c-8262-05afda9bb2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.708078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb951808-e556-4b6c-8262-05afda9bb2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.708350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb951808-e556-4b6c-8262-05afda9bb2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.709065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb951808-e556-4b6c-8262-05afda9bb2c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:31.709382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb951808-e556-4b6c-8262-05afda9bb2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:31.710757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb951808-e556-4b6c-8262-05afda9bb2c9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:31.718477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 91/197] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:31.722390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3201ce-b2e7-4e67-8e94-814bc02f7950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.722541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb951808-e556-4b6c-8262-05afda9bb2c9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.723339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3201ce-b2e7-4e67-8e94-814bc02f7950 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.723625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3201ce-b2e7-4e67-8e94-814bc02f7950 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.723897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3201ce-b2e7-4e67-8e94-814bc02f7950 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.725025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3201ce-b2e7-4e67-8e94-814bc02f7950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:31.726468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3201ce-b2e7-4e67-8e94-814bc02f7950 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:31.728522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 107/198] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:31.729316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3201ce-b2e7-4e67-8e94-814bc02f7950 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.731822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:31.826280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb951808-e556-4b6c-8262-05afda9bb2c9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.826835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3201ce-b2e7-4e67-8e94-814bc02f7950 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.827672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:31.859326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de22e6-f754-4102-9074-544193c020a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.859792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5311bf4-70c9-4cd3-9629-9aff6bc8c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:31.859930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de22e6-f754-4102-9074-544193c020a8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.860211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de22e6-f754-4102-9074-544193c020a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.860423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5311bf4-70c9-4cd3-9629-9aff6bc8c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:31.860513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de22e6-f754-4102-9074-544193c020a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.860705 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5311bf4-70c9-4cd3-9629-9aff6bc8c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:31.860987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5311bf4-70c9-4cd3-9629-9aff6bc8c1e5 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:31.862168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5311bf4-70c9-4cd3-9629-9aff6bc8c1e5 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:31.863621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5311bf4-70c9-4cd3-9629-9aff6bc8c1e5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:31.865277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 108/199] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:31.866111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5311bf4-70c9-4cd3-9629-9aff6bc8c1e5 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:31.928931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de22e6-f754-4102-9074-544193c020a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:31.930984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de22e6-f754-4102-9074-544193c020a8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:31.934068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:31.964767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5311bf4-70c9-4cd3-9629-9aff6bc8c1e5 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:31.999788 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f9242-9f84-4c0c-8186-f88f72912030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.000421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f9242-9f84-4c0c-8186-f88f72912030 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.000704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f9242-9f84-4c0c-8186-f88f72912030 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.000984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f9242-9f84-4c0c-8186-f88f72912030 None admin] PATH_INFO: `/v3/users/12640bef4ca9457eb9e8a4529b60d6db` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.002183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f9242-9f84-4c0c-8186-f88f72912030 None admin] RBAC: Authorizing `identity:get_user(user_id=12640bef4ca9457eb9e8a4529b60d6db)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.003618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f9242-9f84-4c0c-8186-f88f72912030 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.005248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 109/200] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/users/12640bef4ca9457eb9e8a4529b60d6db => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:32.006016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f9242-9f84-4c0c-8186-f88f72912030 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.031858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 92/201] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:32.032681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de22e6-f754-4102-9074-544193c020a8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.035256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:32.107306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f9242-9f84-4c0c-8186-f88f72912030 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.128821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de22e6-f754-4102-9074-544193c020a8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.141048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baa534-5aba-4b75-a4fe-4e5999107fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baa534-5aba-4b75-a4fe-4e5999107fbf None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.141970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baa534-5aba-4b75-a4fe-4e5999107fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.142245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baa534-5aba-4b75-a4fe-4e5999107fbf None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.142924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baa534-5aba-4b75-a4fe-4e5999107fbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.144356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baa534-5aba-4b75-a4fe-4e5999107fbf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.154361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:32.163584 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60521b-608a-4fc5-ab49-8b5dd04c5556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.164189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60521b-608a-4fc5-ab49-8b5dd04c5556 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.164985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60521b-608a-4fc5-ab49-8b5dd04c5556 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.165563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60521b-608a-4fc5-ab49-8b5dd04c5556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.166367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60521b-608a-4fc5-ab49-8b5dd04c5556 None admin] RBAC: Adding query filter params (role.id=127662cbe07e4d75a303f7c70bca2244, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5, user.id=84eb3314d4ce476a9b76302290d68077) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:32.166670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60521b-608a-4fc5-ab49-8b5dd04c5556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.167586 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 110/202] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:22:32 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:32.177125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60521b-608a-4fc5-ab49-8b5dd04c5556 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.177220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baa534-5aba-4b75-a4fe-4e5999107fbf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.182794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 93/203] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/role_assignments?user.id=84eb3314d4ce476a9b76302290d68077&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=127662cbe07e4d75a303f7c70bca2244 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:32.184085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60521b-608a-4fc5-ab49-8b5dd04c5556 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.267913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:32.304052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baa534-5aba-4b75-a4fe-4e5999107fbf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.310003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60521b-608a-4fc5-ab49-8b5dd04c5556 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.345931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607269f-01d1-4dfc-9fc0-84ac46ce451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.346870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607269f-01d1-4dfc-9fc0-84ac46ce451e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.347304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607269f-01d1-4dfc-9fc0-84ac46ce451e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.347585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607269f-01d1-4dfc-9fc0-84ac46ce451e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.355876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70be151-6337-43a7-bb5e-605762632d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.356817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70be151-6337-43a7-bb5e-605762632d4a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.357241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70be151-6337-43a7-bb5e-605762632d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.357783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70be151-6337-43a7-bb5e-605762632d4a None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.359104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70be151-6337-43a7-bb5e-605762632d4a None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.360816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70be151-6337-43a7-bb5e-605762632d4a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.362690 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 94/204] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:32.370524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70be151-6337-43a7-bb5e-605762632d4a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.437580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:32.447808 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607269f-01d1-4dfc-9fc0-84ac46ce451e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.449941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607269f-01d1-4dfc-9fc0-84ac46ce451e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.499827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70be151-6337-43a7-bb5e-605762632d4a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.542836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9cc54-8867-4770-a6e4-c85298280e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.543451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9cc54-8867-4770-a6e4-c85298280e33 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.543722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9cc54-8867-4770-a6e4-c85298280e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.543996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9cc54-8867-4770-a6e4-c85298280e33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.545223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9cc54-8867-4770-a6e4-c85298280e33 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=6936fde9a1084ca0af66359685e524bb, user.id=12640bef4ca9457eb9e8a4529b60d6db) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:32.545591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9cc54-8867-4770-a6e4-c85298280e33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.547413 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9cc54-8867-4770-a6e4-c85298280e33 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.550509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:32.556954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 95/205] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/role_assignments?user.id=12640bef4ca9457eb9e8a4529b60d6db&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=999cac3070e64b82b981258349005963 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:32.578249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 111/206] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:32.584690 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9cc54-8867-4770-a6e4-c85298280e33 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.699156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9cc54-8867-4770-a6e4-c85298280e33 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.735816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf9ab2-b699-497b-a739-782ed507a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.736465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf9ab2-b699-497b-a739-782ed507a384 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.736744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf9ab2-b699-497b-a739-782ed507a384 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.737015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf9ab2-b699-497b-a739-782ed507a384 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.738197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf9ab2-b699-497b-a739-782ed507a384 None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.739644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf9ab2-b699-497b-a739-782ed507a384 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.741300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 96/207] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:32.747780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607269f-01d1-4dfc-9fc0-84ac46ce451e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:32.842125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:32.848667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607269f-01d1-4dfc-9fc0-84ac46ce451e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:32.886572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a619522-dcdf-4e74-a92f-d003da621b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:32.887198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a619522-dcdf-4e74-a92f-d003da621b8b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:32.887478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a619522-dcdf-4e74-a92f-d003da621b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:32.887757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a619522-dcdf-4e74-a92f-d003da621b8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:32.888550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a619522-dcdf-4e74-a92f-d003da621b8b None admin] RBAC: Adding query filter params (role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=6936fde9a1084ca0af66359685e524bb, user.id=12640bef4ca9457eb9e8a4529b60d6db) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:32.888858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a619522-dcdf-4e74-a92f-d003da621b8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:32.890319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a619522-dcdf-4e74-a92f-d003da621b8b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:32.896391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 112/208] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:32 2022] GET /identity/v3/role_assignments?user.id=12640bef4ca9457eb9e8a4529b60d6db&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:34.414165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63dc37-9ba1-481d-be31-f128bd886d68 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.414720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63dc37-9ba1-481d-be31-f128bd886d68 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.414720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63dc37-9ba1-481d-be31-f128bd886d68 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.416105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 97/209] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:34.421479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af123a-9802-4ba0-9d89-63369be71f14 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.421876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af123a-9802-4ba0-9d89-63369be71f14 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.422069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af123a-9802-4ba0-9d89-63369be71f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.437023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40a2ef-44a7-4608-af25-66c7e7383305 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.437672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40a2ef-44a7-4608-af25-66c7e7383305 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.438170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40a2ef-44a7-4608-af25-66c7e7383305 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.439718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 98/210] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:22:34.442095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f2af123a-9802-4ba0-9d89-63369be71f14 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:34.443297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f2af123a-9802-4ba0-9d89-63369be71f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:34.446147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f8fe-3f92-4e2f-8a5f-ed0d6c077c04 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.446648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f8fe-3f92-4e2f-8a5f-ed0d6c077c04 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.447116 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f8fe-3f92-4e2f-8a5f-ed0d6c077c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.465060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9a18f8fe-3f92-4e2f-8a5f-ed0d6c077c04 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:34.466586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9a18f8fe-3f92-4e2f-8a5f-ed0d6c077c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:34.520569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 113/211] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:34.538147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:34.546773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 99/212] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:34.547621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af123a-9802-4ba0-9d89-63369be71f14 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:34.577675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f8fe-3f92-4e2f-8a5f-ed0d6c077c04 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:34.639775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:34.652114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af123a-9802-4ba0-9d89-63369be71f14 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:34.689052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f8fe-3f92-4e2f-8a5f-ed0d6c077c04 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:34.690426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9d901-1368-4b45-a680-fadc431300ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:34.691079 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9d901-1368-4b45-a680-fadc431300ee None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.691358 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9d901-1368-4b45-a680-fadc431300ee None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.691636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9d901-1368-4b45-a680-fadc431300ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.702440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9d901-1368-4b45-a680-fadc431300ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-a7b9d901-1368-4b45-a680-fadc431300ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:34.707356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:34.708219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:34.709071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 114/213] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:34.710202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef7d9a-474b-47b6-a9d6-812d73abc4ba None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.710202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef7d9a-474b-47b6-a9d6-812d73abc4ba None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.710326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef7d9a-474b-47b6-a9d6-812d73abc4ba None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.711846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 115/214] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:34.716374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef7d9a-474b-47b6-a9d6-812d73abc4ba None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:34.732999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0654202-c409-4193-af68-64d6174915dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:34.733948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0654202-c409-4193-af68-64d6174915dd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.734424 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0654202-c409-4193-af68-64d6174915dd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.734866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0654202-c409-4193-af68-64d6174915dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.736168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0654202-c409-4193-af68-64d6174915dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:34.737846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0654202-c409-4193-af68-64d6174915dd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:34.739798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 100/215] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:34.746276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9609c7-90c6-434a-bd30-2fdb26420008 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.746566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9609c7-90c6-434a-bd30-2fdb26420008 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.746840 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9609c7-90c6-434a-bd30-2fdb26420008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.767091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3c9609c7-90c6-434a-bd30-2fdb26420008 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:34.768274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3c9609c7-90c6-434a-bd30-2fdb26420008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:34.824003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef7d9a-474b-47b6-a9d6-812d73abc4ba None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:34.830511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:34.849352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 101/216] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:34.849352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9609c7-90c6-434a-bd30-2fdb26420008 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:34.874767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa49b91-2a59-43bb-ad8b-079b127f7f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:34.875393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa49b91-2a59-43bb-ad8b-079b127f7f7f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.875681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa49b91-2a59-43bb-ad8b-079b127f7f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.875950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa49b91-2a59-43bb-ad8b-079b127f7f7f None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.876682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa49b91-2a59-43bb-ad8b-079b127f7f7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:34.876967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa49b91-2a59-43bb-ad8b-079b127f7f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:34.878490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa49b91-2a59-43bb-ad8b-079b127f7f7f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:34.891133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 116/217] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:34.891133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa49b91-2a59-43bb-ad8b-079b127f7f7f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:34.900292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:34.958549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9609c7-90c6-434a-bd30-2fdb26420008 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:34.989418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa49b91-2a59-43bb-ad8b-079b127f7f7f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:34.991900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7342782-06f5-4322-9db1-0179aa1b62ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:34.992545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7342782-06f5-4322-9db1-0179aa1b62ac None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:34.992823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7342782-06f5-4322-9db1-0179aa1b62ac None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:34.993096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7342782-06f5-4322-9db1-0179aa1b62ac None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:34.993807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7342782-06f5-4322-9db1-0179aa1b62ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:34.995238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7342782-06f5-4322-9db1-0179aa1b62ac None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:35.017117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 102/218] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:22:34 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:35.018039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7342782-06f5-4322-9db1-0179aa1b62ac None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:35.031280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d486d-de7f-477d-8d79-eb9707b87de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:35.032066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d486d-de7f-477d-8d79-eb9707b87de3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:35.032400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d486d-de7f-477d-8d79-eb9707b87de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:35.032739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d486d-de7f-477d-8d79-eb9707b87de3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:35.045607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d486d-de7f-477d-8d79-eb9707b87de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-aa3d486d-de7f-477d-8d79-eb9707b87de3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:35.051191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:35.052141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:35.052925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 117/219] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:35.054144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52341cce-a44f-4c74-ab77-014d18d42288 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:35.054545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52341cce-a44f-4c74-ab77-014d18d42288 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:35.054645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52341cce-a44f-4c74-ab77-014d18d42288 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:35.060184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 118/220] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:35.060350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52341cce-a44f-4c74-ab77-014d18d42288 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:35.086855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:35.147099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:35.152327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7342782-06f5-4322-9db1-0179aa1b62ac None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:35.186290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52341cce-a44f-4c74-ab77-014d18d42288 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:35.195550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61af89d-690d-4a46-8e45-53a4599aa717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:35.196202 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61af89d-690d-4a46-8e45-53a4599aa717 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:35.196749 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61af89d-690d-4a46-8e45-53a4599aa717 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:35.196749 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61af89d-690d-4a46-8e45-53a4599aa717 None admin] PATH_INFO: `/v3/users/c893af6c9eea422ba487f761c2e6fc4c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:35.214583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61af89d-690d-4a46-8e45-53a4599aa717 None admin] RBAC: Authorizing `identity:get_user(user_id=c893af6c9eea422ba487f761c2e6fc4c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:35.217367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61af89d-690d-4a46-8e45-53a4599aa717 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:35.218126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 103/221] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:35 2022] GET /identity/v3/users/c893af6c9eea422ba487f761c2e6fc4c => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:35.219436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b03f-9029-4d70-8aa6-17d10e67ffb6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:35.219709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b03f-9029-4d70-8aa6-17d10e67ffb6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:35.220146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b03f-9029-4d70-8aa6-17d10e67ffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:35.227973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ecfe-28b8-4b36-bf4a-656cc19e7118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:35.229511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ecfe-28b8-4b36-bf4a-656cc19e7118 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:35.229797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ecfe-28b8-4b36-bf4a-656cc19e7118 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:35.230828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ecfe-28b8-4b36-bf4a-656cc19e7118 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:35.230828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ecfe-28b8-4b36-bf4a-656cc19e7118 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:35.231073 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ecfe-28b8-4b36-bf4a-656cc19e7118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:35.232427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ecfe-28b8-4b36-bf4a-656cc19e7118 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:35.239656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-64f3b03f-9029-4d70-8aa6-17d10e67ffb6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:35.241001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-64f3b03f-9029-4d70-8aa6-17d10e67ffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:35.242143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 119/222] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:35.246267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ecfe-28b8-4b36-bf4a-656cc19e7118 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:35.327699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 104/223] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:35.328645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b03f-9029-4d70-8aa6-17d10e67ffb6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:35.371274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:35.382509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ecfe-28b8-4b36-bf4a-656cc19e7118 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:35.438800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:35.444193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4af0f-7a92-490c-9bb1-a115e8cc2fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:35.444820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4af0f-7a92-490c-9bb1-a115e8cc2fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:35.445116 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4af0f-7a92-490c-9bb1-a115e8cc2fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:35.446022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4af0f-7a92-490c-9bb1-a115e8cc2fc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:35.463489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b03f-9029-4d70-8aa6-17d10e67ffb6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:35.534163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d42f-2547-4292-9ecc-0e0364bc31b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:35.534737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d42f-2547-4292-9ecc-0e0364bc31b1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:35.535014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d42f-2547-4292-9ecc-0e0364bc31b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:35.535338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d42f-2547-4292-9ecc-0e0364bc31b1 None admin] PATH_INFO: `/v3/users/12640bef4ca9457eb9e8a4529b60d6db` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:35.536758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d42f-2547-4292-9ecc-0e0364bc31b1 None admin] RBAC: Authorizing `identity:get_user(user_id=12640bef4ca9457eb9e8a4529b60d6db)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:35.538243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d42f-2547-4292-9ecc-0e0364bc31b1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:35.544855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 105/224] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:35 2022] GET /identity/v3/users/12640bef4ca9457eb9e8a4529b60d6db => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:35.544855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d42f-2547-4292-9ecc-0e0364bc31b1 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:35.566035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4af0f-7a92-490c-9bb1-a115e8cc2fc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:35.568084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4af0f-7a92-490c-9bb1-a115e8cc2fc1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:35.731110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d42f-2547-4292-9ecc-0e0364bc31b1 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:35.745009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:35.749946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 120/225] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:35.755755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4af0f-7a92-490c-9bb1-a115e8cc2fc1 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:35.790067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40088-ef1b-443a-8e03-dd24d4191ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:35.794234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40088-ef1b-443a-8e03-dd24d4191ddc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:35.795442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40088-ef1b-443a-8e03-dd24d4191ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:35.796727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d40088-ef1b-443a-8e03-dd24d4191ddc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:35.801922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:35.840112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d40088-ef1b-443a-8e03-dd24d4191ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-40d40088-ef1b-443a-8e03-dd24d4191ddc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:35.863110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:35.864044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:35.864814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:35.868021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 106/226] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:35.869116 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40088-ef1b-443a-8e03-dd24d4191ddc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:35.878949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4af0f-7a92-490c-9bb1-a115e8cc2fc1 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:35.959122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea6f44-2c98-4b7b-be75-d7a33b46ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:35.959786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea6f44-2c98-4b7b-be75-d7a33b46ea94 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:35.960063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea6f44-2c98-4b7b-be75-d7a33b46ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:35.960334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea6f44-2c98-4b7b-be75-d7a33b46ea94 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:35.961597 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea6f44-2c98-4b7b-be75-d7a33b46ea94 None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:35.963650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea6f44-2c98-4b7b-be75-d7a33b46ea94 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:35.965933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 121/227] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:35 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:35.967163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea6f44-2c98-4b7b-be75-d7a33b46ea94 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:36.014624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d40088-ef1b-443a-8e03-dd24d4191ddc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.055809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85571-d803-433a-803b-387699c01e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.056401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85571-d803-433a-803b-387699c01e8b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.056681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85571-d803-433a-803b-387699c01e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.056953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85571-d803-433a-803b-387699c01e8b None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.058326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa85571-d803-433a-803b-387699c01e8b None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.060873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa85571-d803-433a-803b-387699c01e8b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.067253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 107/228] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:35 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:36.067253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85571-d803-433a-803b-387699c01e8b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:36.100765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:36.104455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea6f44-2c98-4b7b-be75-d7a33b46ea94 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.110455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:36.148038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6998-2d9f-4ce6-b177-12cb190d99b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.148658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6998-2d9f-4ce6-b177-12cb190d99b2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.148934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6998-2d9f-4ce6-b177-12cb190d99b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.149202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6998-2d9f-4ce6-b177-12cb190d99b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.149946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e6998-2d9f-4ce6-b177-12cb190d99b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:36.150247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e6998-2d9f-4ce6-b177-12cb190d99b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.151611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e6998-2d9f-4ce6-b177-12cb190d99b2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.163026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 122/229] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:36.164844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6998-2d9f-4ce6-b177-12cb190d99b2 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:36.197974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85571-d803-433a-803b-387699c01e8b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.233418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4dd82-3e1c-4f8b-938b-92a37da77005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.234144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4dd82-3e1c-4f8b-938b-92a37da77005 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.234430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4dd82-3e1c-4f8b-938b-92a37da77005 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.234706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4dd82-3e1c-4f8b-938b-92a37da77005 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb/users/12640bef4ca9457eb9e8a4529b60d6db/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.236672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4dd82-3e1c-4f8b-938b-92a37da77005 None admin] RBAC: Authorizing `identity:create_grant(project_id=6936fde9a1084ca0af66359685e524bb, user_id=12640bef4ca9457eb9e8a4529b60d6db, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.238161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4dd82-3e1c-4f8b-938b-92a37da77005 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.253313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 108/230] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:36 2022] PUT /identity/v3/projects/6936fde9a1084ca0af66359685e524bb/users/12640bef4ca9457eb9e8a4529b60d6db/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:36.254033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4dd82-3e1c-4f8b-938b-92a37da77005 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:36.293905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6998-2d9f-4ce6-b177-12cb190d99b2 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.335064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3a571-9442-4574-ae5b-faf5498ea2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.336175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3a571-9442-4574-ae5b-faf5498ea2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.336656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3a571-9442-4574-ae5b-faf5498ea2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.337124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3a571-9442-4574-ae5b-faf5498ea2f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.338144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3a571-9442-4574-ae5b-faf5498ea2f3 None admin] RBAC: Adding query filter params (role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=6936fde9a1084ca0af66359685e524bb, user.id=c893af6c9eea422ba487f761c2e6fc4c) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:36.338670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3a571-9442-4574-ae5b-faf5498ea2f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.340418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3a571-9442-4574-ae5b-faf5498ea2f3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.347173 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 123/231] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:36 2022] GET /identity/v3/role_assignments?user.id=c893af6c9eea422ba487f761c2e6fc4c&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=2fcd0ee644864d67833017de80ba1627 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:36.373367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:36.385828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4dd82-3e1c-4f8b-938b-92a37da77005 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.436329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9b8e9-b666-44e2-8c81-424361cc1866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.436994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9b8e9-b666-44e2-8c81-424361cc1866 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.437275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9b8e9-b666-44e2-8c81-424361cc1866 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.437599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9b8e9-b666-44e2-8c81-424361cc1866 None admin] PATH_INFO: `/v3/users/12640bef4ca9457eb9e8a4529b60d6db` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.438841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9b8e9-b666-44e2-8c81-424361cc1866 None admin] RBAC: Authorizing `identity:get_user(user_id=12640bef4ca9457eb9e8a4529b60d6db)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.440319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9b8e9-b666-44e2-8c81-424361cc1866 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.442434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 109/232] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:36 2022] GET /identity/v3/users/12640bef4ca9457eb9e8a4529b60d6db => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:36.447916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3a571-9442-4574-ae5b-faf5498ea2f3 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:36.481088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:36.568411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3a571-9442-4574-ae5b-faf5498ea2f3 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.606205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d1d5b-94cf-4e7a-89fd-82b587ebf5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.606774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d1d5b-94cf-4e7a-89fd-82b587ebf5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.607053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d1d5b-94cf-4e7a-89fd-82b587ebf5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.607326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d1d5b-94cf-4e7a-89fd-82b587ebf5e5 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.608495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d1d5b-94cf-4e7a-89fd-82b587ebf5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.609984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d1d5b-94cf-4e7a-89fd-82b587ebf5e5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.612151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 124/233] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:36 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:36.617534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9b8e9-b666-44e2-8c81-424361cc1866 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:36.722350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9b8e9-b666-44e2-8c81-424361cc1866 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:36.757573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fb52f-8753-4bfd-9092-13b2b603ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:36.758437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fb52f-8753-4bfd-9092-13b2b603ab26 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:36.758717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fb52f-8753-4bfd-9092-13b2b603ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:36.758992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fb52f-8753-4bfd-9092-13b2b603ab26 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb/users/12640bef4ca9457eb9e8a4529b60d6db/roles/9bd0594bb1684b5eaa192f6669a7fc36` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:36.761204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fb52f-8753-4bfd-9092-13b2b603ab26 None admin] RBAC: Authorizing `identity:create_grant(project_id=6936fde9a1084ca0af66359685e524bb, user_id=12640bef4ca9457eb9e8a4529b60d6db, role_id=9bd0594bb1684b5eaa192f6669a7fc36)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:36.762738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fb52f-8753-4bfd-9092-13b2b603ab26 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:36.778467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 110/234] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:36 2022] PUT /identity/v3/projects/6936fde9a1084ca0af66359685e524bb/users/12640bef4ca9457eb9e8a4529b60d6db/roles/9bd0594bb1684b5eaa192f6669a7fc36 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:22:37.427157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f30b5-010a-4dbe-93bb-db0325b64fc2 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:37.427528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f30b5-010a-4dbe-93bb-db0325b64fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:37.427728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f30b5-010a-4dbe-93bb-db0325b64fc2 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:37.429429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 125/235] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:37.435565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f54fd-d655-412b-9960-55e8e5333b6a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:37.435858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f54fd-d655-412b-9960-55e8e5333b6a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:37.436137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f54fd-d655-412b-9960-55e8e5333b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:37.462314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-917f54fd-d655-412b-9960-55e8e5333b6a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:37.463512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-917f54fd-d655-412b-9960-55e8e5333b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:37.487544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:37.556668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 111/236] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:37.595400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f54fd-d655-412b-9960-55e8e5333b6a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:37.596137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d3c1b-b394-4a49-9007-1af9caf4bdd9 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:37.596940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d3c1b-b394-4a49-9007-1af9caf4bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:37.597448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d3c1b-b394-4a49-9007-1af9caf4bdd9 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:37.599272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 126/237] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:37.604982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb16c12-0c83-4325-964b-91aee0519d7a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:37.605522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb16c12-0c83-4325-964b-91aee0519d7a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:37.606015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb16c12-0c83-4325-964b-91aee0519d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:37.626736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-1fb16c12-0c83-4325-964b-91aee0519d7a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:37.628333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1fb16c12-0c83-4325-964b-91aee0519d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:37.737318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 127/238] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:37.772163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f54fd-d655-412b-9960-55e8e5333b6a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:37.793365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb16c12-0c83-4325-964b-91aee0519d7a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:37.830771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:37.833380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acaee7-40e2-4cc2-82bb-d774e28396c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:37.834122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acaee7-40e2-4cc2-82bb-d774e28396c9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:37.834448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acaee7-40e2-4cc2-82bb-d774e28396c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:37.834976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acaee7-40e2-4cc2-82bb-d774e28396c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:37.853902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acaee7-40e2-4cc2-82bb-d774e28396c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-89acaee7-40e2-4cc2-82bb-d774e28396c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:37.860700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:37.861624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:37.862402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 112/239] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:37.870494 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acaee7-40e2-4cc2-82bb-d774e28396c9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:37.899641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:37.938018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb16c12-0c83-4325-964b-91aee0519d7a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:37.978395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d89de0-dea3-43d9-80e8-973939bf2a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:37.979034 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d89de0-dea3-43d9-80e8-973939bf2a33 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:37.979312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d89de0-dea3-43d9-80e8-973939bf2a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:37.979582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d89de0-dea3-43d9-80e8-973939bf2a33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:37.980818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d89de0-dea3-43d9-80e8-973939bf2a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:37.982292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d89de0-dea3-43d9-80e8-973939bf2a33 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:37.986300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 128/240] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:37.994309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d89de0-dea3-43d9-80e8-973939bf2a33 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:38.044960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acaee7-40e2-4cc2-82bb-d774e28396c9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:38.106014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53250f90-bbcf-4040-a9c3-3a7d049d555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:38.106639 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53250f90-bbcf-4040-a9c3-3a7d049d555c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:38.106919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53250f90-bbcf-4040-a9c3-3a7d049d555c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:38.107192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53250f90-bbcf-4040-a9c3-3a7d049d555c None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:38.107909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53250f90-bbcf-4040-a9c3-3a7d049d555c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:38.108212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53250f90-bbcf-4040-a9c3-3a7d049d555c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:38.109624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53250f90-bbcf-4040-a9c3-3a7d049d555c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:38.128625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 113/241] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:38.134049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53250f90-bbcf-4040-a9c3-3a7d049d555c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:38.138412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:38.148011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d89de0-dea3-43d9-80e8-973939bf2a33 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:38.186612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f52a56-6036-46ca-8533-895d59bf82ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:38.187240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f52a56-6036-46ca-8533-895d59bf82ba None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:38.187523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f52a56-6036-46ca-8533-895d59bf82ba None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:38.187800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f52a56-6036-46ca-8533-895d59bf82ba None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:38.188596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f52a56-6036-46ca-8533-895d59bf82ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:38.190305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f52a56-6036-46ca-8533-895d59bf82ba None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:38.220360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 129/242] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:22:37 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:38.312411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:38.353539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53250f90-bbcf-4040-a9c3-3a7d049d555c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:38.405367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdd679-68b1-406a-98c6-cd213de706a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:38.406281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdd679-68b1-406a-98c6-cd213de706a3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:38.406562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdd679-68b1-406a-98c6-cd213de706a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:38.406836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdd679-68b1-406a-98c6-cd213de706a3 None admin] PATH_INFO: `/v3/users/2b1b4b1fcd4d4842b8c7ab856511b0e8` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:38.423529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdd679-68b1-406a-98c6-cd213de706a3 None admin] RBAC: Authorizing `identity:get_user(user_id=2b1b4b1fcd4d4842b8c7ab856511b0e8)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:38.425298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdd679-68b1-406a-98c6-cd213de706a3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:38.427651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 114/243] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:38 2022] GET /identity/v3/users/2b1b4b1fcd4d4842b8c7ab856511b0e8 => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:38.433831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f52a56-6036-46ca-8533-895d59bf82ba None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:38.543132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f52a56-6036-46ca-8533-895d59bf82ba None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:38.582557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0dc9b-395d-404e-9faf-c012d8086847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:38.583195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0dc9b-395d-404e-9faf-c012d8086847 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:38.583477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0dc9b-395d-404e-9faf-c012d8086847 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:38.583756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0dc9b-395d-404e-9faf-c012d8086847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:38.605254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:38.659488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0dc9b-395d-404e-9faf-c012d8086847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:38.661095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0dc9b-395d-404e-9faf-c012d8086847 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:38.777834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 130/244] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:38.783879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdd679-68b1-406a-98c6-cd213de706a3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:38.842136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87466a7b-b350-490a-b72c-49cf1ad5b6cc None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:38.842442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87466a7b-b350-490a-b72c-49cf1ad5b6cc None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:38.842625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87466a7b-b350-490a-b72c-49cf1ad5b6cc None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:38.843989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 131/245] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:38.848983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d22fa-6c42-4f63-b88b-41f966879055 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:38.849269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d22fa-6c42-4f63-b88b-41f966879055 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:38.849604 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d22fa-6c42-4f63-b88b-41f966879055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:38.869839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4e9d22fa-6c42-4f63-b88b-41f966879055 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:38.870953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4e9d22fa-6c42-4f63-b88b-41f966879055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:38.903974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdd679-68b1-406a-98c6-cd213de706a3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:38.932490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:38.938388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:38.943834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfb18c-6ee4-4a34-96c6-f09258505d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:38.945197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfb18c-6ee4-4a34-96c6-f09258505d96 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:38.945197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfb18c-6ee4-4a34-96c6-f09258505d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:38.945197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfb18c-6ee4-4a34-96c6-f09258505d96 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:38.948204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfb18c-6ee4-4a34-96c6-f09258505d96 None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:38.949815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfb18c-6ee4-4a34-96c6-f09258505d96 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:38.951820 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 115/246] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:38 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:38.953037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146c89a-c0ec-4fc5-8d8f-5a90d7211575 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:38.953268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146c89a-c0ec-4fc5-8d8f-5a90d7211575 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:38.953672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146c89a-c0ec-4fc5-8d8f-5a90d7211575 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:38.955252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 116/247] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:38.964274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ebcb-7bf4-4b6b-bd06-49b9cbd846eb None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:38.964638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ebcb-7bf4-4b6b-bd06-49b9cbd846eb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:38.964982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ebcb-7bf4-4b6b-bd06-49b9cbd846eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:38.965979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 132/248] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:38.967023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d22fa-6c42-4f63-b88b-41f966879055 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:38.993435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-93a0ebcb-7bf4-4b6b-bd06-49b9cbd846eb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:38.994722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-93a0ebcb-7bf4-4b6b-bd06-49b9cbd846eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:39.089418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 117/249] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:39.090525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0ebcb-7bf4-4b6b-bd06-49b9cbd846eb None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:39.095360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d22fa-6c42-4f63-b88b-41f966879055 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:39.156615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361aa97-cfd1-4f3d-959c-cd9668c9248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:39.157646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361aa97-cfd1-4f3d-959c-cd9668c9248e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.158082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361aa97-cfd1-4f3d-959c-cd9668c9248e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.162267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361aa97-cfd1-4f3d-959c-cd9668c9248e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.163260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361aa97-cfd1-4f3d-959c-cd9668c9248e None admin] RBAC: Adding query filter params (role.id=127662cbe07e4d75a303f7c70bca2244, scope.project.id=6936fde9a1084ca0af66359685e524bb, user.id=2b1b4b1fcd4d4842b8c7ab856511b0e8) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:39.163715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361aa97-cfd1-4f3d-959c-cd9668c9248e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:39.167525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361aa97-cfd1-4f3d-959c-cd9668c9248e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:39.177296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 133/250] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:38 2022] GET /identity/v3/role_assignments?user.id=2b1b4b1fcd4d4842b8c7ab856511b0e8&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=127662cbe07e4d75a303f7c70bca2244 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:39.178495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361aa97-cfd1-4f3d-959c-cd9668c9248e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:39.241800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:39.300392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361aa97-cfd1-4f3d-959c-cd9668c9248e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:39.340816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d14b42-3f08-4238-a12d-f84ce1e8da55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:39.342086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d14b42-3f08-4238-a12d-f84ce1e8da55 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.342474 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d14b42-3f08-4238-a12d-f84ce1e8da55 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.342991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d14b42-3f08-4238-a12d-f84ce1e8da55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.348303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0ebcb-7bf4-4b6b-bd06-49b9cbd846eb None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:39.357141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d14b42-3f08-4238-a12d-f84ce1e8da55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-76d14b42-3f08-4238-a12d-f84ce1e8da55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:39.364998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:39.365956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:39.366714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 134/251] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:39.368485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db932a-b21a-45e6-8a26-04f46fdb1bc8 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.368687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db932a-b21a-45e6-8a26-04f46fdb1bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.368960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db932a-b21a-45e6-8a26-04f46fdb1bc8 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.370833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 135/252] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:39.373510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db932a-b21a-45e6-8a26-04f46fdb1bc8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:39.385484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:39.393830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b8089-2a9a-49da-b5a9-0b1e9495e872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:39.394785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b8089-2a9a-49da-b5a9-0b1e9495e872 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.395262 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b8089-2a9a-49da-b5a9-0b1e9495e872 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.395730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b8089-2a9a-49da-b5a9-0b1e9495e872 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.408087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b8089-2a9a-49da-b5a9-0b1e9495e872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-3a6b8089-2a9a-49da-b5a9-0b1e9495e872 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:39.416582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:39.417548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:39.418330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:39.420715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 118/253] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:39.422132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cda37-ff6b-4c7c-8595-fc3f76368272 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.422729 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cda37-ff6b-4c7c-8595-fc3f76368272 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.423196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cda37-ff6b-4c7c-8595-fc3f76368272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.444487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-dd6cda37-ff6b-4c7c-8595-fc3f76368272 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:39.446240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dd6cda37-ff6b-4c7c-8595-fc3f76368272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:39.507694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db932a-b21a-45e6-8a26-04f46fdb1bc8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:39.509514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:39.525022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 119/254] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:39.526308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cda37-ff6b-4c7c-8595-fc3f76368272 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:39.550043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127012d0-313a-457b-96bf-eb31d4561f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:39.550702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127012d0-313a-457b-96bf-eb31d4561f06 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.553395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127012d0-313a-457b-96bf-eb31d4561f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.553988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127012d0-313a-457b-96bf-eb31d4561f06 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.556778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127012d0-313a-457b-96bf-eb31d4561f06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:39.557086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127012d0-313a-457b-96bf-eb31d4561f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:39.558924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127012d0-313a-457b-96bf-eb31d4561f06 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:39.571242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 136/255] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:39.571242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127012d0-313a-457b-96bf-eb31d4561f06 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:39.659070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cda37-ff6b-4c7c-8595-fc3f76368272 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:39.684079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:39.705498 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17a3b-2716-40e0-90e5-08b6968c4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:39.706430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17a3b-2716-40e0-90e5-08b6968c4934 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.706890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17a3b-2716-40e0-90e5-08b6968c4934 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.707338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b17a3b-2716-40e0-90e5-08b6968c4934 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.708220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b17a3b-2716-40e0-90e5-08b6968c4934 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:39.708693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b17a3b-2716-40e0-90e5-08b6968c4934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:39.710273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b17a3b-2716-40e0-90e5-08b6968c4934 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:39.730492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 120/256] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:39.733305 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17a3b-2716-40e0-90e5-08b6968c4934 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:39.749922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127012d0-313a-457b-96bf-eb31d4561f06 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:39.799632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f4a11-a61e-44e8-9162-795463fd1f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:39.800602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f4a11-a61e-44e8-9162-795463fd1f6a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.801055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f4a11-a61e-44e8-9162-795463fd1f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.801538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f4a11-a61e-44e8-9162-795463fd1f6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.822005 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f4a11-a61e-44e8-9162-795463fd1f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-e72f4a11-a61e-44e8-9162-795463fd1f6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:39.827248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:39.828111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:39.828893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:39.834225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 137/257] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:39.835988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f4a11-a61e-44e8-9162-795463fd1f6a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:39.886514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:39.925437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b17a3b-2716-40e0-90e5-08b6968c4934 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:39.979105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464e6b-f4aa-49ec-a44d-7b3970593674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:39.979748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464e6b-f4aa-49ec-a44d-7b3970593674 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:39.980027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464e6b-f4aa-49ec-a44d-7b3970593674 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:39.980298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82464e6b-f4aa-49ec-a44d-7b3970593674 None admin] PATH_INFO: `/v3/users/12640bef4ca9457eb9e8a4529b60d6db` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:39.984557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82464e6b-f4aa-49ec-a44d-7b3970593674 None admin] RBAC: Authorizing `identity:get_user(user_id=12640bef4ca9457eb9e8a4529b60d6db)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:39.986074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82464e6b-f4aa-49ec-a44d-7b3970593674 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:39.993147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 121/258] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:39 2022] GET /identity/v3/users/12640bef4ca9457eb9e8a4529b60d6db => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:39.994070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464e6b-f4aa-49ec-a44d-7b3970593674 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:40.043137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f4a11-a61e-44e8-9162-795463fd1f6a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:40.106400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:40.107610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf599fb-61be-4875-ab9a-097ed26154b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:40.108261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf599fb-61be-4875-ab9a-097ed26154b2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:40.108543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf599fb-61be-4875-ab9a-097ed26154b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:40.108817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf599fb-61be-4875-ab9a-097ed26154b2 None admin] PATH_INFO: `/v3/users/c893af6c9eea422ba487f761c2e6fc4c` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:40.113101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf599fb-61be-4875-ab9a-097ed26154b2 None admin] RBAC: Authorizing `identity:get_user(user_id=c893af6c9eea422ba487f761c2e6fc4c)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:40.114712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf599fb-61be-4875-ab9a-097ed26154b2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:40.117736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 138/259] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:39 2022] GET /identity/v3/users/c893af6c9eea422ba487f761c2e6fc4c => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:40.118525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf599fb-61be-4875-ab9a-097ed26154b2 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:40.183548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82464e6b-f4aa-49ec-a44d-7b3970593674 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:40.224620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f963b36-97e9-4b48-9569-dd24ee8b5d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:40.225237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f963b36-97e9-4b48-9569-dd24ee8b5d63 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:40.225544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f963b36-97e9-4b48-9569-dd24ee8b5d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:40.225818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f963b36-97e9-4b48-9569-dd24ee8b5d63 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:40.227042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f963b36-97e9-4b48-9569-dd24ee8b5d63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:40.227345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f963b36-97e9-4b48-9569-dd24ee8b5d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:40.228728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f963b36-97e9-4b48-9569-dd24ee8b5d63 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:40.238158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 122/260] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:40.238975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f963b36-97e9-4b48-9569-dd24ee8b5d63 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:40.317916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:40.339495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf599fb-61be-4875-ab9a-097ed26154b2 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:40.366258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f963b36-97e9-4b48-9569-dd24ee8b5d63 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:40.393886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:40.407073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876539-e4f1-4d20-b7e6-d350e83608ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:40.407724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876539-e4f1-4d20-b7e6-d350e83608ae None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:40.408928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876539-e4f1-4d20-b7e6-d350e83608ae None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:40.409215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876539-e4f1-4d20-b7e6-d350e83608ae None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:40.411540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e876539-e4f1-4d20-b7e6-d350e83608ae None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:40.412999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e876539-e4f1-4d20-b7e6-d350e83608ae None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:40.414802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 123/261] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:40 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:40.415577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876539-e4f1-4d20-b7e6-d350e83608ae None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:40.423269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bb9ac-92e2-4e65-a0dc-fb7112f167cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:40.423887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bb9ac-92e2-4e65-a0dc-fb7112f167cd None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:40.424169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bb9ac-92e2-4e65-a0dc-fb7112f167cd None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:40.424445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bb9ac-92e2-4e65-a0dc-fb7112f167cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:40.502015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bb9ac-92e2-4e65-a0dc-fb7112f167cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:40.503402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bb9ac-92e2-4e65-a0dc-fb7112f167cd None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:40.605341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:40.616761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 139/262] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:40.618174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bb9ac-92e2-4e65-a0dc-fb7112f167cd None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:40.729990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876539-e4f1-4d20-b7e6-d350e83608ae None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:40.739490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bb9ac-92e2-4e65-a0dc-fb7112f167cd None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:40.769722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20fa4a-e46a-46fa-831e-4bd38de6c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:40.770293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20fa4a-e46a-46fa-831e-4bd38de6c75a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:40.770578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20fa4a-e46a-46fa-831e-4bd38de6c75a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:40.770855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20fa4a-e46a-46fa-831e-4bd38de6c75a None admin] PATH_INFO: `/v3/users/12640bef4ca9457eb9e8a4529b60d6db` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:40.772246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20fa4a-e46a-46fa-831e-4bd38de6c75a None admin] RBAC: Authorizing `identity:get_user(user_id=12640bef4ca9457eb9e8a4529b60d6db)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:40.773913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20fa4a-e46a-46fa-831e-4bd38de6c75a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:40.775982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 124/263] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:40 2022] GET /identity/v3/users/12640bef4ca9457eb9e8a4529b60d6db => generated 283 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:40.776769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20fa4a-e46a-46fa-831e-4bd38de6c75a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:40.837619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:40.843383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7eea7-de73-4773-9c3f-07be6aa21469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:40.845598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7eea7-de73-4773-9c3f-07be6aa21469 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:40.845598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7eea7-de73-4773-9c3f-07be6aa21469 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:40.845598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7eea7-de73-4773-9c3f-07be6aa21469 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb/users/c893af6c9eea422ba487f761c2e6fc4c/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:40.850789 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7eea7-de73-4773-9c3f-07be6aa21469 None admin] RBAC: Authorizing `identity:create_grant(project_id=6936fde9a1084ca0af66359685e524bb, user_id=c893af6c9eea422ba487f761c2e6fc4c, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:40.853028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7eea7-de73-4773-9c3f-07be6aa21469 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:40.885192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 140/264] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:40 2022] PUT /identity/v3/projects/6936fde9a1084ca0af66359685e524bb/users/c893af6c9eea422ba487f761c2e6fc4c/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:40.886352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7eea7-de73-4773-9c3f-07be6aa21469 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:40.895100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20fa4a-e46a-46fa-831e-4bd38de6c75a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:40.937683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b107f81-caa9-47bb-ba3c-0b59d6eb7fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:40.939063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b107f81-caa9-47bb-ba3c-0b59d6eb7fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:40.939886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b107f81-caa9-47bb-ba3c-0b59d6eb7fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:40.940314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b107f81-caa9-47bb-ba3c-0b59d6eb7fb5 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:40.941694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b107f81-caa9-47bb-ba3c-0b59d6eb7fb5 None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:40.943894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b107f81-caa9-47bb-ba3c-0b59d6eb7fb5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:40.945962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 125/265] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:40 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:40.952023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b107f81-caa9-47bb-ba3c-0b59d6eb7fb5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:41.051464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:41.073310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b107f81-caa9-47bb-ba3c-0b59d6eb7fb5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:41.097742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:41.112699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278e37-f26c-4869-b073-36ad187c2cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:41.113755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278e37-f26c-4869-b073-36ad187c2cfb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.114287 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278e37-f26c-4869-b073-36ad187c2cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.114803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278e37-f26c-4869-b073-36ad187c2cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.115880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278e37-f26c-4869-b073-36ad187c2cfb None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=6936fde9a1084ca0af66359685e524bb, user.id=12640bef4ca9457eb9e8a4529b60d6db) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:41.116404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278e37-f26c-4869-b073-36ad187c2cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:41.118365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278e37-f26c-4869-b073-36ad187c2cfb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:41.125681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 126/266] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:40 2022] GET /identity/v3/role_assignments?user.id=12640bef4ca9457eb9e8a4529b60d6db&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=999cac3070e64b82b981258349005963 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:41.151771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7eea7-de73-4773-9c3f-07be6aa21469 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:41.155887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff1b9-59da-4d08-b003-0364efd00a9e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.156196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff1b9-59da-4d08-b003-0364efd00a9e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.156447 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff1b9-59da-4d08-b003-0364efd00a9e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.157911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 127/267] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:22:41.170293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128ad52-8a26-49fe-9fe5-63911df36e12 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.170606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128ad52-8a26-49fe-9fe5-63911df36e12 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.170845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128ad52-8a26-49fe-9fe5-63911df36e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.193871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0128ad52-8a26-49fe-9fe5-63911df36e12 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:41.195862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0128ad52-8a26-49fe-9fe5-63911df36e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:41.209261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83817404-1160-4b75-8fc8-1dd87cea2117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:41.210336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83817404-1160-4b75-8fc8-1dd87cea2117 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.211444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83817404-1160-4b75-8fc8-1dd87cea2117 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.211952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83817404-1160-4b75-8fc8-1dd87cea2117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.301372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 128/268] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:41.308686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83817404-1160-4b75-8fc8-1dd87cea2117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:41.310208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83817404-1160-4b75-8fc8-1dd87cea2117 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:41.320751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128ad52-8a26-49fe-9fe5-63911df36e12 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:41.405022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:41.505470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128ad52-8a26-49fe-9fe5-63911df36e12 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:41.508925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 141/269] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:41.515384 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83817404-1160-4b75-8fc8-1dd87cea2117 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:41.519729 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:41.551710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a98e8-f12d-47eb-a882-2490cf620c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:41.552763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a98e8-f12d-47eb-a882-2490cf620c5b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.553246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a98e8-f12d-47eb-a882-2490cf620c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.553730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a98e8-f12d-47eb-a882-2490cf620c5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.565533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a98e8-f12d-47eb-a882-2490cf620c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-cb5a98e8-f12d-47eb-a882-2490cf620c5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:41.571376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:41.572263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:41.573051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:41.576046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 129/270] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:41.583757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a98e8-f12d-47eb-a882-2490cf620c5b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:41.681011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83817404-1160-4b75-8fc8-1dd87cea2117 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:41.721550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97631f45-8206-4a5d-9c49-c7c8950063f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:41.722694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97631f45-8206-4a5d-9c49-c7c8950063f3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.723238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97631f45-8206-4a5d-9c49-c7c8950063f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.723705 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97631f45-8206-4a5d-9c49-c7c8950063f3 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.725095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97631f45-8206-4a5d-9c49-c7c8950063f3 None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:41.726959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97631f45-8206-4a5d-9c49-c7c8950063f3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:41.729069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 142/271] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:41 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:41.730497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7c047-538d-4a42-b00b-61b15a7e7157 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.730977 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7c047-538d-4a42-b00b-61b15a7e7157 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.731440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7c047-538d-4a42-b00b-61b15a7e7157 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.733110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 143/272] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:41.737074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7c047-538d-4a42-b00b-61b15a7e7157 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:41.743174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a98e8-f12d-47eb-a882-2490cf620c5b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:41.764566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:41.783683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8d7c-eacf-43d1-8da7-fa025c3fbad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:41.784304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8d7c-eacf-43d1-8da7-fa025c3fbad0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.784582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8d7c-eacf-43d1-8da7-fa025c3fbad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.784856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8d7c-eacf-43d1-8da7-fa025c3fbad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.785599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b8d7c-eacf-43d1-8da7-fa025c3fbad0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:41.785900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b8d7c-eacf-43d1-8da7-fa025c3fbad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:41.787339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b8d7c-eacf-43d1-8da7-fa025c3fbad0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:41.796879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 130/273] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:41.798004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d45cd-1ac6-44a8-a4c3-b56a17e8721a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.798348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d45cd-1ac6-44a8-a4c3-b56a17e8721a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.798622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d45cd-1ac6-44a8-a4c3-b56a17e8721a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.819082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-757d45cd-1ac6-44a8-a4c3-b56a17e8721a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:41.820257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-757d45cd-1ac6-44a8-a4c3-b56a17e8721a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:41.847813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:41.863102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7c047-538d-4a42-b00b-61b15a7e7157 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:41.891555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 131/274] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:41.897412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab6bb-8c68-46dd-9047-6dec9b03707a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.897412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab6bb-8c68-46dd-9047-6dec9b03707a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.897412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ab6bb-8c68-46dd-9047-6dec9b03707a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.897412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 132/275] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:41.897412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab6bb-8c68-46dd-9047-6dec9b03707a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:41.908805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ca307-3aa8-4493-91b7-0da01915f77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:41.909529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ca307-3aa8-4493-91b7-0da01915f77b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.909798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ca307-3aa8-4493-91b7-0da01915f77b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.910023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ca307-3aa8-4493-91b7-0da01915f77b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.910818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ca307-3aa8-4493-91b7-0da01915f77b None admin] RBAC: Adding query filter params (role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=6936fde9a1084ca0af66359685e524bb, user.id=12640bef4ca9457eb9e8a4529b60d6db) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:41.911122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ca307-3aa8-4493-91b7-0da01915f77b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:41.912552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ca307-3aa8-4493-91b7-0da01915f77b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:41.918969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 144/276] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:41 2022] GET /identity/v3/role_assignments?user.id=12640bef4ca9457eb9e8a4529b60d6db&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:41.920224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f124-1d44-4cc9-8871-6cf990205aa6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:41.920510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f124-1d44-4cc9-8871-6cf990205aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:41.920784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f124-1d44-4cc9-8871-6cf990205aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:41.945956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e497f124-1d44-4cc9-8871-6cf990205aa6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:41.948151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e497f124-1d44-4cc9-8871-6cf990205aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:42.038419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 145/277] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:42.039758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f124-1d44-4cc9-8871-6cf990205aa6 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:42.049146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ab6bb-8c68-46dd-9047-6dec9b03707a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:42.058986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:42.102031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3df9a6-d496-441a-9609-44281c32bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:42.102594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df9a6-d496-441a-9609-44281c32bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:42.102779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df9a6-d496-441a-9609-44281c32bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:42.103032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df9a6-d496-441a-9609-44281c32bfa8 None admin] PATH_INFO: `/v3/users/522f74e8e2d64cc694565d461129a50c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:42.120971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3df9a6-d496-441a-9609-44281c32bfa8 None admin] RBAC: Authorizing `identity:get_user(user_id=522f74e8e2d64cc694565d461129a50c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:42.122983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3df9a6-d496-441a-9609-44281c32bfa8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:42.125486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 133/278] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:41 2022] GET /identity/v3/users/522f74e8e2d64cc694565d461129a50c => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:42.127085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3df9a6-d496-441a-9609-44281c32bfa8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:42.150777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:42.163128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f124-1d44-4cc9-8871-6cf990205aa6 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:42.203207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45e2a7-7a04-4406-8d42-f38f70cc95bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:42.203845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e2a7-7a04-4406-8d42-f38f70cc95bc None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:42.204120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e2a7-7a04-4406-8d42-f38f70cc95bc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:42.204402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e2a7-7a04-4406-8d42-f38f70cc95bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:42.205621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45e2a7-7a04-4406-8d42-f38f70cc95bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:42.207047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45e2a7-7a04-4406-8d42-f38f70cc95bc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:42.208633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 146/279] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:42.209435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45e2a7-7a04-4406-8d42-f38f70cc95bc None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:42.254027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3df9a6-d496-441a-9609-44281c32bfa8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:42.291675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60086c-1629-4882-bace-770e9d21dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:42.292659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60086c-1629-4882-bace-770e9d21dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:42.292934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60086c-1629-4882-bace-770e9d21dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:42.293209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60086c-1629-4882-bace-770e9d21dbe9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:42.295494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:42.305450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60086c-1629-4882-bace-770e9d21dbe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0d60086c-1629-4882-bace-770e9d21dbe9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:42.310350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:42.311246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:42.312023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 134/280] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:42.312666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60086c-1629-4882-bace-770e9d21dbe9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:42.321233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45e2a7-7a04-4406-8d42-f38f70cc95bc None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:42.360968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d32af-cc19-4f67-85a6-c76663473e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:42.361677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d32af-cc19-4f67-85a6-c76663473e66 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:42.362072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d32af-cc19-4f67-85a6-c76663473e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:42.362446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d32af-cc19-4f67-85a6-c76663473e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:42.363334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d32af-cc19-4f67-85a6-c76663473e66 None admin] RBAC: Adding query filter params (role.id=2fcd0ee644864d67833017de80ba1627, user.id=522f74e8e2d64cc694565d461129a50c, scope.system=all) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:42.363745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d32af-cc19-4f67-85a6-c76663473e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:42.365249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d32af-cc19-4f67-85a6-c76663473e66 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:42.371083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 147/281] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Aug 4 02:22:42 2022] GET /identity/v3/role_assignments?user.id=522f74e8e2d64cc694565d461129a50c&scope.system=all&role.id=2fcd0ee644864d67833017de80ba1627 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:42.381619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d32af-cc19-4f67-85a6-c76663473e66 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:42.412992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:42.436788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60086c-1629-4882-bace-770e9d21dbe9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:42.477813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc3ef-72fb-4fcb-85b4-41b46a97b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:42.478564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc3ef-72fb-4fcb-85b4-41b46a97b873 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:42.478903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc3ef-72fb-4fcb-85b4-41b46a97b873 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:42.479238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc3ef-72fb-4fcb-85b4-41b46a97b873 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:42.480104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bc3ef-72fb-4fcb-85b4-41b46a97b873 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:42.481813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bc3ef-72fb-4fcb-85b4-41b46a97b873 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:42.509891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 135/282] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:22:42 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:42.526385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d32af-cc19-4f67-85a6-c76663473e66 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:42.570801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d34868-1381-4c47-a124-9fd689151877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:42.571677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d34868-1381-4c47-a124-9fd689151877 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:42.572120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d34868-1381-4c47-a124-9fd689151877 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:42.572528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d34868-1381-4c47-a124-9fd689151877 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:42.573675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d34868-1381-4c47-a124-9fd689151877 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:42.573769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d34868-1381-4c47-a124-9fd689151877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:42.580283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d34868-1381-4c47-a124-9fd689151877 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:42.590634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 148/283] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:42.596640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc3ef-72fb-4fcb-85b4-41b46a97b873 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:42.712327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc3ef-72fb-4fcb-85b4-41b46a97b873 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:42.748670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4763594-60be-40a7-bf4c-5d55fad1b49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:42.749317 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4763594-60be-40a7-bf4c-5d55fad1b49b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:42.749667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4763594-60be-40a7-bf4c-5d55fad1b49b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:42.749947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4763594-60be-40a7-bf4c-5d55fad1b49b None admin] PATH_INFO: `/v3/users/2b1b4b1fcd4d4842b8c7ab856511b0e8` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:42.751163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4763594-60be-40a7-bf4c-5d55fad1b49b None admin] RBAC: Authorizing `identity:get_user(user_id=2b1b4b1fcd4d4842b8c7ab856511b0e8)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:42.752671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4763594-60be-40a7-bf4c-5d55fad1b49b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:42.754657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 136/284] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:42 2022] GET /identity/v3/users/2b1b4b1fcd4d4842b8c7ab856511b0e8 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:42.760306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d34868-1381-4c47-a124-9fd689151877 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:42.777488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:42.873477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d34868-1381-4c47-a124-9fd689151877 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:42.912034 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd32d5-2ab1-4e6a-a14f-feca728a977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:42.912675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd32d5-2ab1-4e6a-a14f-feca728a977e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:42.913008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd32d5-2ab1-4e6a-a14f-feca728a977e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:42.913287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd32d5-2ab1-4e6a-a14f-feca728a977e None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:42.915012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd32d5-2ab1-4e6a-a14f-feca728a977e None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:42.916437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd32d5-2ab1-4e6a-a14f-feca728a977e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:42.918556 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 149/285] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:42 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:42.924119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4763594-60be-40a7-bf4c-5d55fad1b49b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:42.933760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:43.045087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4763594-60be-40a7-bf4c-5d55fad1b49b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:43.084803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7401870-d0b5-47fa-9098-ba78686636e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:43.085568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7401870-d0b5-47fa-9098-ba78686636e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:43.085833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7401870-d0b5-47fa-9098-ba78686636e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:43.086108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7401870-d0b5-47fa-9098-ba78686636e6 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb/users/2b1b4b1fcd4d4842b8c7ab856511b0e8/roles/127662cbe07e4d75a303f7c70bca2244` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:43.088123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7401870-d0b5-47fa-9098-ba78686636e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6936fde9a1084ca0af66359685e524bb, user_id=2b1b4b1fcd4d4842b8c7ab856511b0e8, role_id=127662cbe07e4d75a303f7c70bca2244)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:43.089607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7401870-d0b5-47fa-9098-ba78686636e6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:43.117949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 137/286] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:22:42 2022] PUT /identity/v3/projects/6936fde9a1084ca0af66359685e524bb/users/2b1b4b1fcd4d4842b8c7ab856511b0e8/roles/127662cbe07e4d75a303f7c70bca2244 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:22:43.378075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4ddd-5410-469c-a5e0-e9271f6b87f8 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:43.378407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4ddd-5410-469c-a5e0-e9271f6b87f8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:43.378581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4ddd-5410-469c-a5e0-e9271f6b87f8 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:43.379970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 150/287] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:43.386033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaae5b-91fe-48ec-ae39-c5fa0a0f2092 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:43.386319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaae5b-91fe-48ec-ae39-c5fa0a0f2092 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:43.386598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaae5b-91fe-48ec-ae39-c5fa0a0f2092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:43.405320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bbdaae5b-91fe-48ec-ae39-c5fa0a0f2092 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:43.407363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bbdaae5b-91fe-48ec-ae39-c5fa0a0f2092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:43.484725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:43.500202 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 138/288] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:43.546868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4ddd-5410-469c-a5e0-e9271f6b87f8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:43.665543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:43.703682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4ddd-5410-469c-a5e0-e9271f6b87f8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:43.750479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048f31-1ea0-4295-86d0-302319274b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:43.751126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048f31-1ea0-4295-86d0-302319274b84 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:43.751504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048f31-1ea0-4295-86d0-302319274b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:43.751781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49048f31-1ea0-4295-86d0-302319274b84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:43.766048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49048f31-1ea0-4295-86d0-302319274b84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-49048f31-1ea0-4295-86d0-302319274b84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:43.771422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:43.772275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:43.773068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 151/289] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:43.778789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaae5b-91fe-48ec-ae39-c5fa0a0f2092 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:43.889206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaae5b-91fe-48ec-ae39-c5fa0a0f2092 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:43.923190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f17c5-8883-4ab6-8de4-a91a9a0a4a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:43.923737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f17c5-8883-4ab6-8de4-a91a9a0a4a56 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:43.924015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f17c5-8883-4ab6-8de4-a91a9a0a4a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:43.924288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f17c5-8883-4ab6-8de4-a91a9a0a4a56 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:43.924995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f17c5-8883-4ab6-8de4-a91a9a0a4a56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:43.925295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f17c5-8883-4ab6-8de4-a91a9a0a4a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:43.926713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f17c5-8883-4ab6-8de4-a91a9a0a4a56 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:43.939396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 139/290] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:43.944971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048f31-1ea0-4295-86d0-302319274b84 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:44.071471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49048f31-1ea0-4295-86d0-302319274b84 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:44.121937 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dc718-f81e-47f5-b3a1-edac681a95d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:44.122625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dc718-f81e-47f5-b3a1-edac681a95d3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.122904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dc718-f81e-47f5-b3a1-edac681a95d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.123179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dc718-f81e-47f5-b3a1-edac681a95d3 None admin] PATH_INFO: `/v3/users/c893af6c9eea422ba487f761c2e6fc4c` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.124504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dc718-f81e-47f5-b3a1-edac681a95d3 None admin] RBAC: Authorizing `identity:get_user(user_id=c893af6c9eea422ba487f761c2e6fc4c)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:44.126024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27dc718-f81e-47f5-b3a1-edac681a95d3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:44.127756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 152/291] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:43 2022] GET /identity/v3/users/c893af6c9eea422ba487f761c2e6fc4c => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:44.133979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f17c5-8883-4ab6-8de4-a91a9a0a4a56 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:44.201469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:44.253770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f17c5-8883-4ab6-8de4-a91a9a0a4a56 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:44.295691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff37fc-f115-4b24-abbe-dc5d6505700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:44.296308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff37fc-f115-4b24-abbe-dc5d6505700c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.296585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff37fc-f115-4b24-abbe-dc5d6505700c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.296856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff37fc-f115-4b24-abbe-dc5d6505700c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.384465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff37fc-f115-4b24-abbe-dc5d6505700c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:44.385984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff37fc-f115-4b24-abbe-dc5d6505700c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:44.461048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:44.508698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 140/292] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:44.514419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dc718-f81e-47f5-b3a1-edac681a95d3 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:44.524609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:44.652496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27dc718-f81e-47f5-b3a1-edac681a95d3 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:44.704468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c810d-d605-4601-afe5-25995463d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:44.705124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c810d-d605-4601-afe5-25995463d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.705430 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c810d-d605-4601-afe5-25995463d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.705712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c810d-d605-4601-afe5-25995463d8f0 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.706904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c810d-d605-4601-afe5-25995463d8f0 None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:44.708345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c810d-d605-4601-afe5-25995463d8f0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:44.710363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 153/293] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:44 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:44.716747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff37fc-f115-4b24-abbe-dc5d6505700c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:44.842312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb632e2-292f-41e1-a434-2eddc7a8d453 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.842634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb632e2-292f-41e1-a434-2eddc7a8d453 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.842866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb632e2-292f-41e1-a434-2eddc7a8d453 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.844399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 154/294] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:22:44.856467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa25c-bb8e-4370-bf66-b7ac106339e0 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.856756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa25c-bb8e-4370-bf66-b7ac106339e0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.857034 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa25c-bb8e-4370-bf66-b7ac106339e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.876814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff37fc-f115-4b24-abbe-dc5d6505700c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:44.898846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ca1aa25c-bb8e-4370-bf66-b7ac106339e0 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:44.900057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ca1aa25c-bb8e-4370-bf66-b7ac106339e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:44.915792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0496d03-70cc-4426-8189-3bdbfa5ad1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:44.916407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0496d03-70cc-4426-8189-3bdbfa5ad1dc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:44.916687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0496d03-70cc-4426-8189-3bdbfa5ad1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:44.916956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0496d03-70cc-4426-8189-3bdbfa5ad1dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:44.917765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0496d03-70cc-4426-8189-3bdbfa5ad1dc None admin] RBAC: Adding query filter params (role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=6936fde9a1084ca0af66359685e524bb, user.id=c893af6c9eea422ba487f761c2e6fc4c) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:44.918130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0496d03-70cc-4426-8189-3bdbfa5ad1dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:44.920093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0496d03-70cc-4426-8189-3bdbfa5ad1dc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:44.927406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 141/295] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:44 2022] GET /identity/v3/role_assignments?user.id=c893af6c9eea422ba487f761c2e6fc4c&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=2fcd0ee644864d67833017de80ba1627 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:44.989799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 155/296] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:45.011984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0496d03-70cc-4426-8189-3bdbfa5ad1dc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:45.042417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:45.147890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0496d03-70cc-4426-8189-3bdbfa5ad1dc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:45.184818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef85e2-062f-4cf2-a40a-66719d840c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:45.185501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef85e2-062f-4cf2-a40a-66719d840c34 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.185782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef85e2-062f-4cf2-a40a-66719d840c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.186052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef85e2-062f-4cf2-a40a-66719d840c34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.197080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef85e2-062f-4cf2-a40a-66719d840c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-2fef85e2-062f-4cf2-a40a-66719d840c34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:45.205459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:45.206353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:45.207789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 142/297] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:45.213132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa25c-bb8e-4370-bf66-b7ac106339e0 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:45.215320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:45.266097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263a8a8-fe7c-4899-a531-cce56f6b6182 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.266294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263a8a8-fe7c-4899-a531-cce56f6b6182 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.266556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263a8a8-fe7c-4899-a531-cce56f6b6182 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.268193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 143/298] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:22:45.272956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987f84-47ef-43fe-ade3-fe2076eee02e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.273948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987f84-47ef-43fe-ade3-fe2076eee02e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.274222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987f84-47ef-43fe-ade3-fe2076eee02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.299924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3f987f84-47ef-43fe-ade3-fe2076eee02e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:45.301125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3f987f84-47ef-43fe-ade3-fe2076eee02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:45.350123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa25c-bb8e-4370-bf66-b7ac106339e0 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:45.380736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 144/299] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:45.382424 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4443-6d01-4006-a61c-18ac777d18a5 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.383599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4443-6d01-4006-a61c-18ac777d18a5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.384063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4443-6d01-4006-a61c-18ac777d18a5 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.385746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 145/300] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:45.390509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c68f65-b5d0-4baa-b92f-4d6caf23338b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.390857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c68f65-b5d0-4baa-b92f-4d6caf23338b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.391214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c68f65-b5d0-4baa-b92f-4d6caf23338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.396908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd5c8a-976b-4047-8263-abc6ddbd5023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:45.397796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd5c8a-976b-4047-8263-abc6ddbd5023 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.398814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd5c8a-976b-4047-8263-abc6ddbd5023 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.399087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd5c8a-976b-4047-8263-abc6ddbd5023 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.399808 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd5c8a-976b-4047-8263-abc6ddbd5023 None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:45.400108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd5c8a-976b-4047-8263-abc6ddbd5023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:45.401525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd5c8a-976b-4047-8263-abc6ddbd5023 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:45.414626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 156/301] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:45.414626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd5c8a-976b-4047-8263-abc6ddbd5023 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:45.414896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-50c68f65-b5d0-4baa-b92f-4d6caf23338b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:45.415699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-50c68f65-b5d0-4baa-b92f-4d6caf23338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:45.418738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:45.481790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:45.493753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 146/302] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:45.494745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c68f65-b5d0-4baa-b92f-4d6caf23338b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:45.531320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd5c8a-976b-4047-8263-abc6ddbd5023 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:45.568447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279565a-587f-4529-b321-7d7d49d4f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:45.569351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279565a-587f-4529-b321-7d7d49d4f952 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.569779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279565a-587f-4529-b321-7d7d49d4f952 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.570808 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279565a-587f-4529-b321-7d7d49d4f952 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.582284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279565a-587f-4529-b321-7d7d49d4f952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-1279565a-587f-4529-b321-7d7d49d4f952 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:45.587751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:45.588616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:45.589415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 157/303] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:45.590085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279565a-587f-4529-b321-7d7d49d4f952 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:45.614439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c68f65-b5d0-4baa-b92f-4d6caf23338b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:45.655091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cdbae-62cb-42ce-9a8f-a3f4b7172d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:45.656308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdbae-62cb-42ce-9a8f-a3f4b7172d68 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.656714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdbae-62cb-42ce-9a8f-a3f4b7172d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.657226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdbae-62cb-42ce-9a8f-a3f4b7172d68 None admin] PATH_INFO: `/v3/users/522f74e8e2d64cc694565d461129a50c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.658525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cdbae-62cb-42ce-9a8f-a3f4b7172d68 None admin] RBAC: Authorizing `identity:get_user(user_id=522f74e8e2d64cc694565d461129a50c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:45.660199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cdbae-62cb-42ce-9a8f-a3f4b7172d68 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:45.661959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 147/304] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:45 2022] GET /identity/v3/users/522f74e8e2d64cc694565d461129a50c => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:45.662844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cdbae-62cb-42ce-9a8f-a3f4b7172d68 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:45.674555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:45.694005 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279565a-587f-4529-b321-7d7d49d4f952 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:45.718601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:45.730210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65702c-9a84-45bc-92dd-d8bf5d89b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:45.730850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65702c-9a84-45bc-92dd-d8bf5d89b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.731134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65702c-9a84-45bc-92dd-d8bf5d89b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.731413 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65702c-9a84-45bc-92dd-d8bf5d89b1b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.733599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65702c-9a84-45bc-92dd-d8bf5d89b1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:45.735044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65702c-9a84-45bc-92dd-d8bf5d89b1b7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:45.736646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 158/305] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:45.742945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65702c-9a84-45bc-92dd-d8bf5d89b1b7 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:45.783253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cdbae-62cb-42ce-9a8f-a3f4b7172d68 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:45.818295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e24e5-554e-4d3b-8fe4-be8a05a8035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:45.818907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e24e5-554e-4d3b-8fe4-be8a05a8035f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.819183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e24e5-554e-4d3b-8fe4-be8a05a8035f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.819523 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e24e5-554e-4d3b-8fe4-be8a05a8035f None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.820806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e24e5-554e-4d3b-8fe4-be8a05a8035f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:45.821104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e24e5-554e-4d3b-8fe4-be8a05a8035f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:45.822512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e24e5-554e-4d3b-8fe4-be8a05a8035f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:45.830937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 148/306] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:45.831693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e24e5-554e-4d3b-8fe4-be8a05a8035f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:45.850799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65702c-9a84-45bc-92dd-d8bf5d89b1b7 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:45.884940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8d83-e5f9-4c06-97e0-f8c5dba2537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:45.885638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8d83-e5f9-4c06-97e0-f8c5dba2537e None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.885920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8d83-e5f9-4c06-97e0-f8c5dba2537e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.886199 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8d83-e5f9-4c06-97e0-f8c5dba2537e None admin] PATH_INFO: `/v3/system/users/522f74e8e2d64cc694565d461129a50c/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.887678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b8d83-e5f9-4c06-97e0-f8c5dba2537e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=522f74e8e2d64cc694565d461129a50c, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:45.889046 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b8d83-e5f9-4c06-97e0-f8c5dba2537e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:45.899125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 159/307] 10.222.0.69 () {58 vars in 1334 bytes} [Thu Aug 4 02:22:45 2022] PUT /identity/v3/system/users/522f74e8e2d64cc694565d461129a50c/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:45.899995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8d83-e5f9-4c06-97e0-f8c5dba2537e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:45.911709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:45.946843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e24e5-554e-4d3b-8fe4-be8a05a8035f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:45.966916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:45.985962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b3f95-0820-4951-8205-32f0fc74cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:45.986587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b3f95-0820-4951-8205-32f0fc74cf83 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:45.986863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b3f95-0820-4951-8205-32f0fc74cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:45.987134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b3f95-0820-4951-8205-32f0fc74cf83 None admin] PATH_INFO: `/v3/groups` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:45.987800 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b3f95-0820-4951-8205-32f0fc74cf83 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:45.989246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b3f95-0820-4951-8205-32f0fc74cf83 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:46.006966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 149/308] 10.222.0.69 () {60 vars in 1134 bytes} [Thu Aug 4 02:22:45 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:46.008383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d8b93-54f2-4af8-8e78-db6e45ba04a0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:46.008672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d8b93-54f2-4af8-8e78-db6e45ba04a0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:46.008946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d8b93-54f2-4af8-8e78-db6e45ba04a0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:46.010529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 150/309] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:46.016138 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887b104-6f48-4efe-a1bb-3e8693bf6515 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:46.016455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887b104-6f48-4efe-a1bb-3e8693bf6515 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:46.016701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887b104-6f48-4efe-a1bb-3e8693bf6515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:46.031700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8d83-e5f9-4c06-97e0-f8c5dba2537e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:46.037511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4887b104-6f48-4efe-a1bb-3e8693bf6515 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:46.039253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4887b104-6f48-4efe-a1bb-3e8693bf6515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:46.086152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf054689-cbbb-49c9-b7c0-393821c6e0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:46.086814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf054689-cbbb-49c9-b7c0-393821c6e0ed None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:46.087089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf054689-cbbb-49c9-b7c0-393821c6e0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:46.087373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf054689-cbbb-49c9-b7c0-393821c6e0ed None admin] PATH_INFO: `/v3/users/c090a5039fc84c859faea753c3aad0f8` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:46.105770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf054689-cbbb-49c9-b7c0-393821c6e0ed None admin] RBAC: Authorizing `identity:get_user(user_id=c090a5039fc84c859faea753c3aad0f8)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:46.107233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf054689-cbbb-49c9-b7c0-393821c6e0ed None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:46.109306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 160/310] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:45 2022] GET /identity/v3/users/c090a5039fc84c859faea753c3aad0f8 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:46.115158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf054689-cbbb-49c9-b7c0-393821c6e0ed None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:46.138779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 151/311] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:46.162501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887b104-6f48-4efe-a1bb-3e8693bf6515 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:46.233684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf054689-cbbb-49c9-b7c0-393821c6e0ed None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:46.244120 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:46.253098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:46.290085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388e3b8-2f83-4867-8c70-e4a654dd07a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:46.290924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e3b8-2f83-4867-8c70-e4a654dd07a9 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:46.291049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887b104-6f48-4efe-a1bb-3e8693bf6515 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:46.291490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e3b8-2f83-4867-8c70-e4a654dd07a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:46.291965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388e3b8-2f83-4867-8c70-e4a654dd07a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:46.294140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e3b8-2f83-4867-8c70-e4a654dd07a9 None admin] RBAC: Adding query filter params (role.id=127662cbe07e4d75a303f7c70bca2244, user.id=c090a5039fc84c859faea753c3aad0f8, scope.system=all) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:46.294614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e3b8-2f83-4867-8c70-e4a654dd07a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:46.296252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388e3b8-2f83-4867-8c70-e4a654dd07a9 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:46.303876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 161/312] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Aug 4 02:22:46 2022] GET /identity/v3/role_assignments?user.id=c090a5039fc84c859faea753c3aad0f8&scope.system=all&role.id=127662cbe07e4d75a303f7c70bca2244 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:46.335495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53b4c-4e79-48ab-931e-1fb4464bbc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:46.336203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53b4c-4e79-48ab-931e-1fb4464bbc26 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:46.336483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53b4c-4e79-48ab-931e-1fb4464bbc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:46.336759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac53b4c-4e79-48ab-931e-1fb4464bbc26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:46.349522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac53b4c-4e79-48ab-931e-1fb4464bbc26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0ac53b4c-4e79-48ab-931e-1fb4464bbc26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:46.355135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:46.356242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:46.357204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 152/313] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:46.362507 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388e3b8-2f83-4867-8c70-e4a654dd07a9 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:46.481690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388e3b8-2f83-4867-8c70-e4a654dd07a9 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:46.517287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c2b95-d566-48c8-8945-69590791ae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:46.518189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c2b95-d566-48c8-8945-69590791ae21 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:46.518643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c2b95-d566-48c8-8945-69590791ae21 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:46.519083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c2b95-d566-48c8-8945-69590791ae21 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:46.519922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c2b95-d566-48c8-8945-69590791ae21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:46.520376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c2b95-d566-48c8-8945-69590791ae21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:46.521925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c2b95-d566-48c8-8945-69590791ae21 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:46.531006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 162/314] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:46.536307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53b4c-4e79-48ab-931e-1fb4464bbc26 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:46.650505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac53b4c-4e79-48ab-931e-1fb4464bbc26 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:46.671386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:46.687309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192a77-3b1f-4903-aaff-538748c9abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:46.687950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192a77-3b1f-4903-aaff-538748c9abbc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:46.688225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192a77-3b1f-4903-aaff-538748c9abbc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:46.688501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a192a77-3b1f-4903-aaff-538748c9abbc None admin] PATH_INFO: `/v3/users/2b1b4b1fcd4d4842b8c7ab856511b0e8` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:46.689693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192a77-3b1f-4903-aaff-538748c9abbc None admin] RBAC: Authorizing `identity:get_user(user_id=2b1b4b1fcd4d4842b8c7ab856511b0e8)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:46.691207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a192a77-3b1f-4903-aaff-538748c9abbc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:46.693123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 153/315] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:46 2022] GET /identity/v3/users/2b1b4b1fcd4d4842b8c7ab856511b0e8 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:46.698637 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c2b95-d566-48c8-8945-69590791ae21 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:46.749797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:46.802567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c2b95-d566-48c8-8945-69590791ae21 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:46.836650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8718dbc-afec-4660-991f-befd6359561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:46.837186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8718dbc-afec-4660-991f-befd6359561c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:46.837495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8718dbc-afec-4660-991f-befd6359561c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:46.837767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8718dbc-afec-4660-991f-befd6359561c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:46.904971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8718dbc-afec-4660-991f-befd6359561c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:46.906754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8718dbc-afec-4660-991f-befd6359561c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:46.947254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:47.006714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 163/316] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:47.012203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192a77-3b1f-4903-aaff-538748c9abbc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:47.114635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a192a77-3b1f-4903-aaff-538748c9abbc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:47.152101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b2ed9-1684-43c9-855b-69327a181acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:47.152753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b2ed9-1684-43c9-855b-69327a181acc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:47.153037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b2ed9-1684-43c9-855b-69327a181acc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:47.153315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b2ed9-1684-43c9-855b-69327a181acc None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:47.154516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b2ed9-1684-43c9-855b-69327a181acc None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:47.156227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b2ed9-1684-43c9-855b-69327a181acc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:47.158231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 154/317] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:47 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:47.164288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8718dbc-afec-4660-991f-befd6359561c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:47.266520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8718dbc-afec-4660-991f-befd6359561c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:47.304075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38333d23-5a71-4b93-a319-acdf0404b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:47.304718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333d23-5a71-4b93-a319-acdf0404b130 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:47.304993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333d23-5a71-4b93-a319-acdf0404b130 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:47.305263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333d23-5a71-4b93-a319-acdf0404b130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:47.306126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333d23-5a71-4b93-a319-acdf0404b130 None admin] RBAC: Adding query filter params (role.id=127662cbe07e4d75a303f7c70bca2244, scope.project.id=6936fde9a1084ca0af66359685e524bb, user.id=2b1b4b1fcd4d4842b8c7ab856511b0e8) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:47.306435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333d23-5a71-4b93-a319-acdf0404b130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:47.307868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333d23-5a71-4b93-a319-acdf0404b130 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:47.314703 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 164/318] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:22:47 2022] GET /identity/v3/role_assignments?user.id=2b1b4b1fcd4d4842b8c7ab856511b0e8&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=127662cbe07e4d75a303f7c70bca2244 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:48.055306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875493-40ad-49b9-8296-38dc3a177ad9 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.055848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875493-40ad-49b9-8296-38dc3a177ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.055848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875493-40ad-49b9-8296-38dc3a177ad9 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.057346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 155/319] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:48.062360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f12ca-737b-4372-920a-6cd8f0902182 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.062648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f12ca-737b-4372-920a-6cd8f0902182 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.062922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f12ca-737b-4372-920a-6cd8f0902182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.071883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:48.082670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-088f12ca-737b-4372-920a-6cd8f0902182 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:48.083871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-088f12ca-737b-4372-920a-6cd8f0902182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:48.125278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821658-663b-4c85-86a5-53277b21875f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.125593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821658-663b-4c85-86a5-53277b21875f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.125863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821658-663b-4c85-86a5-53277b21875f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.127325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 156/320] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:22:48.131913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa2005-bd78-48e1-a3ac-6a54367be2a5 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.132196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa2005-bd78-48e1-a3ac-6a54367be2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.132505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa2005-bd78-48e1-a3ac-6a54367be2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.149821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9ffa2005-bd78-48e1-a3ac-6a54367be2a5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:48.150993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9ffa2005-bd78-48e1-a3ac-6a54367be2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:48.153701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 165/321] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:48.176937 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f12ca-737b-4372-920a-6cd8f0902182 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:48.205171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:48.223483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 157/322] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:48.247530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa2005-bd78-48e1-a3ac-6a54367be2a5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:48.281160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f12ca-737b-4372-920a-6cd8f0902182 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:48.315781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae634c-8100-47c6-a26b-e90df18064be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:48.316343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae634c-8100-47c6-a26b-e90df18064be None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.316621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae634c-8100-47c6-a26b-e90df18064be None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.316895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae634c-8100-47c6-a26b-e90df18064be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.318795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:48.328129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae634c-8100-47c6-a26b-e90df18064be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-e5ae634c-8100-47c6-a26b-e90df18064be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:48.333048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:48.334112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 166/323] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:48.340224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2eaba3-52c0-45a3-86bf-a82e70922b0c None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.341306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2eaba3-52c0-45a3-86bf-a82e70922b0c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.341306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2eaba3-52c0-45a3-86bf-a82e70922b0c None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.341306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 167/324] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:48.341306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2eaba3-52c0-45a3-86bf-a82e70922b0c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:48.350258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa2005-bd78-48e1-a3ac-6a54367be2a5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:48.385177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377082bc-b476-4c3f-aa04-0c81f4e5a0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:48.385837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377082bc-b476-4c3f-aa04-0c81f4e5a0fb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.386117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377082bc-b476-4c3f-aa04-0c81f4e5a0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.386396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377082bc-b476-4c3f-aa04-0c81f4e5a0fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.387513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377082bc-b476-4c3f-aa04-0c81f4e5a0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:48.388942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377082bc-b476-4c3f-aa04-0c81f4e5a0fb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:48.390551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 158/325] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:22:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:48.391642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b91aa1-373f-44da-aa52-7d14671c256c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.391918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b91aa1-373f-44da-aa52-7d14671c256c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.392201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b91aa1-373f-44da-aa52-7d14671c256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.409126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-55b91aa1-373f-44da-aa52-7d14671c256c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:48.410322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-55b91aa1-373f-44da-aa52-7d14671c256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:48.446998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2eaba3-52c0-45a3-86bf-a82e70922b0c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:48.459367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:48.477551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 159/326] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:48.478327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b91aa1-373f-44da-aa52-7d14671c256c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:48.481861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659262e6-2aab-4d05-ab06-404f09775455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:48.482471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659262e6-2aab-4d05-ab06-404f09775455 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.482747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659262e6-2aab-4d05-ab06-404f09775455 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.483014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659262e6-2aab-4d05-ab06-404f09775455 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.483711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659262e6-2aab-4d05-ab06-404f09775455 None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:48.484008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659262e6-2aab-4d05-ab06-404f09775455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:48.485376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659262e6-2aab-4d05-ab06-404f09775455 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:48.494143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 168/327] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:48.499435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659262e6-2aab-4d05-ab06-404f09775455 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:48.554158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:48.583713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b91aa1-373f-44da-aa52-7d14671c256c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:48.598122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659262e6-2aab-4d05-ab06-404f09775455 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:48.617410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78ef93-f499-4be1-9fbe-07a8b271b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:48.618022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78ef93-f499-4be1-9fbe-07a8b271b68d None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.618302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78ef93-f499-4be1-9fbe-07a8b271b68d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.618572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78ef93-f499-4be1-9fbe-07a8b271b68d None admin] PATH_INFO: `/v3/groups` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.619225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78ef93-f499-4be1-9fbe-07a8b271b68d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:48.620703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78ef93-f499-4be1-9fbe-07a8b271b68d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:48.632213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f44fd-890d-4c27-832a-23ddd4576e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:48.632850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f44fd-890d-4c27-832a-23ddd4576e58 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.633129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f44fd-890d-4c27-832a-23ddd4576e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.633430 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f44fd-890d-4c27-832a-23ddd4576e58 None admin] PATH_INFO: `/v3/users/522f74e8e2d64cc694565d461129a50c` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.634589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f44fd-890d-4c27-832a-23ddd4576e58 None admin] RBAC: Authorizing `identity:get_user(user_id=522f74e8e2d64cc694565d461129a50c)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:48.635479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 160/328] 10.222.0.69 () {60 vars in 1134 bytes} [Thu Aug 4 02:22:48 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:22:48.653621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f44fd-890d-4c27-832a-23ddd4576e58 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:48.653739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78ef93-f499-4be1-9fbe-07a8b271b68d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:48.653831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 169/329] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:48 2022] GET /identity/v3/users/522f74e8e2d64cc694565d461129a50c => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:48.653831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f44fd-890d-4c27-832a-23ddd4576e58 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:48.692363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:48.756732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78ef93-f499-4be1-9fbe-07a8b271b68d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:48.759276 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f44fd-890d-4c27-832a-23ddd4576e58 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:48.787478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:48.796934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a408a96-86a2-4abd-8ac8-4a5eaf1e4e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:48.797620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408a96-86a2-4abd-8ac8-4a5eaf1e4e72 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.797933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408a96-86a2-4abd-8ac8-4a5eaf1e4e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.798205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408a96-86a2-4abd-8ac8-4a5eaf1e4e72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.803907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3d18-1079-407d-9dcc-5c7a3f1c89ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:48.804741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3d18-1079-407d-9dcc-5c7a3f1c89ba None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.804861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3d18-1079-407d-9dcc-5c7a3f1c89ba None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.805092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3d18-1079-407d-9dcc-5c7a3f1c89ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.805966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea3d18-1079-407d-9dcc-5c7a3f1c89ba None admin] RBAC: Adding query filter params (role.id=2fcd0ee644864d67833017de80ba1627, user.id=522f74e8e2d64cc694565d461129a50c, scope.system=all) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:48.806278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea3d18-1079-407d-9dcc-5c7a3f1c89ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:48.807718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea3d18-1079-407d-9dcc-5c7a3f1c89ba None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:48.811293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a408a96-86a2-4abd-8ac8-4a5eaf1e4e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-6a408a96-86a2-4abd-8ac8-4a5eaf1e4e72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:48.817267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:48.818358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:48.819336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 161/330] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:48.825012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a408a96-86a2-4abd-8ac8-4a5eaf1e4e72 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:48.825456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 170/331] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Aug 4 02:22:48 2022] GET /identity/v3/role_assignments?user.id=522f74e8e2d64cc694565d461129a50c&scope.system=all&role.id=2fcd0ee644864d67833017de80ba1627 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:48.945845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a408a96-86a2-4abd-8ac8-4a5eaf1e4e72 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:48.948547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:48.985015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fe77-45f4-4f73-a212-2ee65feee79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:48.985730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fe77-45f4-4f73-a212-2ee65feee79e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:48.986013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fe77-45f4-4f73-a212-2ee65feee79e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:48.986299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fe77-45f4-4f73-a212-2ee65feee79e None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:48.987017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fe77-45f4-4f73-a212-2ee65feee79e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:48.987323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fe77-45f4-4f73-a212-2ee65feee79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:48.988711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fe77-45f4-4f73-a212-2ee65feee79e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:48.999120 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 162/332] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:49.004177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3d18-1079-407d-9dcc-5c7a3f1c89ba None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:49.115777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3d18-1079-407d-9dcc-5c7a3f1c89ba None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:49.150965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cefcd-2e6f-469b-b64a-1761571d671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:49.151613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cefcd-2e6f-469b-b64a-1761571d671c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:49.151891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cefcd-2e6f-469b-b64a-1761571d671c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:49.152163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cefcd-2e6f-469b-b64a-1761571d671c None admin] PATH_INFO: `/v3/users/c090a5039fc84c859faea753c3aad0f8` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:49.153357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cefcd-2e6f-469b-b64a-1761571d671c None admin] RBAC: Authorizing `identity:get_user(user_id=c090a5039fc84c859faea753c3aad0f8)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:49.154821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cefcd-2e6f-469b-b64a-1761571d671c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:49.157102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 171/333] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:49 2022] GET /identity/v3/users/c090a5039fc84c859faea753c3aad0f8 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:49.162500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fe77-45f4-4f73-a212-2ee65feee79e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:49.278594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fe77-45f4-4f73-a212-2ee65feee79e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:49.315085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6971f79-de4a-4742-9be1-a1efc38ae0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:49.316033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6971f79-de4a-4742-9be1-a1efc38ae0f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:49.316482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6971f79-de4a-4742-9be1-a1efc38ae0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:49.317031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6971f79-de4a-4742-9be1-a1efc38ae0f7 None admin] PATH_INFO: `/v3/system/users/c090a5039fc84c859faea753c3aad0f8/roles/127662cbe07e4d75a303f7c70bca2244` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:49.318707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6971f79-de4a-4742-9be1-a1efc38ae0f7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c090a5039fc84c859faea753c3aad0f8, role_id=127662cbe07e4d75a303f7c70bca2244)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:49.320832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6971f79-de4a-4742-9be1-a1efc38ae0f7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:49.331599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 163/334] 10.222.0.69 () {58 vars in 1334 bytes} [Thu Aug 4 02:22:49 2022] PUT /identity/v3/system/users/c090a5039fc84c859faea753c3aad0f8/roles/127662cbe07e4d75a303f7c70bca2244 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:51.062666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e494-89ef-4c6c-af39-34114e2590a4 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:51.063663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e494-89ef-4c6c-af39-34114e2590a4 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:51.064138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432e494-89ef-4c6c-af39-34114e2590a4 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:51.065975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 172/335] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:51.071460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630ed2-61af-4499-9baa-d465915f7302 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:51.072266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630ed2-61af-4499-9baa-d465915f7302 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:51.072751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630ed2-61af-4499-9baa-d465915f7302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:51.102499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e2630ed2-61af-4499-9baa-d465915f7302 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:51.104063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e2630ed2-61af-4499-9baa-d465915f7302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:51.129882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:51.145183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28128906-be60-4f79-9c54-3054fce484c9 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:51.145553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28128906-be60-4f79-9c54-3054fce484c9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:51.145805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28128906-be60-4f79-9c54-3054fce484c9 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:51.147504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 173/336] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:51.152636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906420a5-d7b4-4bcf-9044-148839cd789c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:51.152918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906420a5-d7b4-4bcf-9044-148839cd789c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:51.153199 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906420a5-d7b4-4bcf-9044-148839cd789c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:51.187776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 164/337] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:51.198473 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-906420a5-d7b4-4bcf-9044-148839cd789c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:51.199701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-906420a5-d7b4-4bcf-9044-148839cd789c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:51.226992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630ed2-61af-4499-9baa-d465915f7302 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:51.285903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:51.343076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 174/338] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:51.366250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630ed2-61af-4499-9baa-d465915f7302 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:51.392944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906420a5-d7b4-4bcf-9044-148839cd789c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:51.416385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ee322-103d-4733-9bba-a0462b61fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:51.417423 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ee322-103d-4733-9bba-a0462b61fa85 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:51.417897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ee322-103d-4733-9bba-a0462b61fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:51.418355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ee322-103d-4733-9bba-a0462b61fa85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:51.429178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ee322-103d-4733-9bba-a0462b61fa85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7e3ee322-103d-4733-9bba-a0462b61fa85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:51.434982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:51.435831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:51.436620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:51.439210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 165/339] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:51.444992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ee322-103d-4733-9bba-a0462b61fa85 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:51.478306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:51.566673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ee322-103d-4733-9bba-a0462b61fa85 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:51.617220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0743c-c20f-41cc-be9a-77f9e7955e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:51.617815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0743c-c20f-41cc-be9a-77f9e7955e0c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:51.618098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0743c-c20f-41cc-be9a-77f9e7955e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:51.618370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0743c-c20f-41cc-be9a-77f9e7955e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:51.619084 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0743c-c20f-41cc-be9a-77f9e7955e0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:51.619385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0743c-c20f-41cc-be9a-77f9e7955e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:51.620775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0743c-c20f-41cc-be9a-77f9e7955e0c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:51.630553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 166/340] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:51.636518 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0743c-c20f-41cc-be9a-77f9e7955e0c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:51.667555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906420a5-d7b4-4bcf-9044-148839cd789c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:51.746593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7a607-fb3f-4ee4-b956-cf5300365e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:51.747249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7a607-fb3f-4ee4-b956-cf5300365e2c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:51.747529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7a607-fb3f-4ee4-b956-cf5300365e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:51.747811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7a607-fb3f-4ee4-b956-cf5300365e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:51.781965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7a607-fb3f-4ee4-b956-cf5300365e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-ece7a607-fb3f-4ee4-b956-cf5300365e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:51.787024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:51.787890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:51.789232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 175/341] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:51.796820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7a607-fb3f-4ee4-b956-cf5300365e2c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:51.802862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:51.842146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0743c-c20f-41cc-be9a-77f9e7955e0c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:51.895825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e94af-353a-46d3-99a7-69e714c967b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:51.896829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e94af-353a-46d3-99a7-69e714c967b1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:51.897301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e94af-353a-46d3-99a7-69e714c967b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:51.897884 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e94af-353a-46d3-99a7-69e714c967b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:51.908698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:51.998339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e94af-353a-46d3-99a7-69e714c967b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:52.000165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e94af-353a-46d3-99a7-69e714c967b1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:52.002492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7a607-fb3f-4ee4-b956-cf5300365e2c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:52.066648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca71b0-f9ae-4177-9161-d219f4c7ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:52.067301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca71b0-f9ae-4177-9161-d219f4c7ee35 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.067537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca71b0-f9ae-4177-9161-d219f4c7ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.067807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca71b0-f9ae-4177-9161-d219f4c7ee35 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.068524 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca71b0-f9ae-4177-9161-d219f4c7ee35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:52.068822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca71b0-f9ae-4177-9161-d219f4c7ee35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:52.070768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca71b0-f9ae-4177-9161-d219f4c7ee35 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:52.083611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 176/342] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:52.084880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c377a-9102-476a-b484-70af931e8d01 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.085162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c377a-9102-476a-b484-70af931e8d01 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.086109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c377a-9102-476a-b484-70af931e8d01 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.087328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 177/343] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:52.092377 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c377a-9102-476a-b484-70af931e8d01 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:52.111068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:52.128865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 167/344] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 02:22:52.131394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d9a39-4eda-4604-a7f2-b00ec5c54721 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.131886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d9a39-4eda-4604-a7f2-b00ec5c54721 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.132899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d9a39-4eda-4604-a7f2-b00ec5c54721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.161992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-245d9a39-4eda-4604-a7f2-b00ec5c54721 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:52.163545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-245d9a39-4eda-4604-a7f2-b00ec5c54721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:52.242566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c377a-9102-476a-b484-70af931e8d01 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:52.249357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:52.295621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 168/345] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:52.296483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d9a39-4eda-4604-a7f2-b00ec5c54721 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:52.309789 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae176b-7e4f-4a89-a74e-fbc0fec61b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:52.310413 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae176b-7e4f-4a89-a74e-fbc0fec61b39 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.310696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae176b-7e4f-4a89-a74e-fbc0fec61b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.310969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae176b-7e4f-4a89-a74e-fbc0fec61b39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.396818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae176b-7e4f-4a89-a74e-fbc0fec61b39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:52.398353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae176b-7e4f-4a89-a74e-fbc0fec61b39 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:52.517920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d9a39-4eda-4604-a7f2-b00ec5c54721 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:52.534612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:52.556952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 178/346] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:52.558223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae176b-7e4f-4a89-a74e-fbc0fec61b39 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:52.561150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:52.567197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d2543-a9e9-4027-9a25-c374db28f55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:52.567859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d2543-a9e9-4027-9a25-c374db28f55f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.568139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d2543-a9e9-4027-9a25-c374db28f55f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.571929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d2543-a9e9-4027-9a25-c374db28f55f None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.572920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d2543-a9e9-4027-9a25-c374db28f55f None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:52.574545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d2543-a9e9-4027-9a25-c374db28f55f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:52.577593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 169/347] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:52 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:52.579389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7de81b-f852-44a4-b772-3c5a8a5cc398 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.579668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7de81b-f852-44a4-b772-3c5a8a5cc398 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.579940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7de81b-f852-44a4-b772-3c5a8a5cc398 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.581992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 170/348] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:52.587872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7de81b-f852-44a4-b772-3c5a8a5cc398 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:52.698816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae176b-7e4f-4a89-a74e-fbc0fec61b39 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:52.716573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7de81b-f852-44a4-b772-3c5a8a5cc398 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:52.742559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03ec2-c804-4f98-ad7f-8fda1be174d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:52.743588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03ec2-c804-4f98-ad7f-8fda1be174d7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.744058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03ec2-c804-4f98-ad7f-8fda1be174d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.744550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03ec2-c804-4f98-ad7f-8fda1be174d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.756115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe03ec2-c804-4f98-ad7f-8fda1be174d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:52.759489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188ee33-adc5-4b74-9d98-9a3c22ff2d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:52.760138 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188ee33-adc5-4b74-9d98-9a3c22ff2d93 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.760858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188ee33-adc5-4b74-9d98-9a3c22ff2d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.760858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188ee33-adc5-4b74-9d98-9a3c22ff2d93 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.761872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188ee33-adc5-4b74-9d98-9a3c22ff2d93 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:52.763309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188ee33-adc5-4b74-9d98-9a3c22ff2d93 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-afe03ec2-c804-4f98-ad7f-8fda1be174d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:52.763990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:52.764864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:52.765701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:52.766303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 171/349] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:52 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:52.768488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 179/350] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:52.769277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188ee33-adc5-4b74-9d98-9a3c22ff2d93 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:52.770270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2281-52af-4f1c-9521-5747336b4ca9 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.770742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2281-52af-4f1c-9521-5747336b4ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.771239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2281-52af-4f1c-9521-5747336b4ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.794397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-655c2281-52af-4f1c-9521-5747336b4ca9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:52.796066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-655c2281-52af-4f1c-9521-5747336b4ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:52.829205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:52.863713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:52.879402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 180/351] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:52.880460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c2281-52af-4f1c-9521-5747336b4ca9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:52.893376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188ee33-adc5-4b74-9d98-9a3c22ff2d93 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:52.935196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3fc1d-ccdb-41fa-9ec1-9c8828d2ee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:52.936174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3fc1d-ccdb-41fa-9ec1-9c8828d2ee5e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:52.936457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3fc1d-ccdb-41fa-9ec1-9c8828d2ee5e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:52.936730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3fc1d-ccdb-41fa-9ec1-9c8828d2ee5e None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:52.943240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3fc1d-ccdb-41fa-9ec1-9c8828d2ee5e None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:52.945223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3fc1d-ccdb-41fa-9ec1-9c8828d2ee5e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:52.947065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 172/352] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:52 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:52.947676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3fc1d-ccdb-41fa-9ec1-9c8828d2ee5e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:53.016127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c2281-52af-4f1c-9521-5747336b4ca9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:53.053428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480b003-5f11-4f8f-bfaa-c0ef4c5aa02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:53.053931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480b003-5f11-4f8f-bfaa-c0ef4c5aa02a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.054730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480b003-5f11-4f8f-bfaa-c0ef4c5aa02a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.055003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480b003-5f11-4f8f-bfaa-c0ef4c5aa02a None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.055716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480b003-5f11-4f8f-bfaa-c0ef4c5aa02a None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:53.056018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480b003-5f11-4f8f-bfaa-c0ef4c5aa02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:53.057404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480b003-5f11-4f8f-bfaa-c0ef4c5aa02a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:53.066654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 181/353] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:53.068132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995acb84-b101-40d6-9da8-b590b2ee992e None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.068671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995acb84-b101-40d6-9da8-b590b2ee992e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.068671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995acb84-b101-40d6-9da8-b590b2ee992e None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.072455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 182/354] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:53.073214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995acb84-b101-40d6-9da8-b590b2ee992e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:53.085466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3fc1d-ccdb-41fa-9ec1-9c8828d2ee5e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:53.102889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:53.131239 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60aa79-1447-4074-a76b-a4ef55c74181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:53.131839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60aa79-1447-4074-a76b-a4ef55c74181 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.132211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60aa79-1447-4074-a76b-a4ef55c74181 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.133003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60aa79-1447-4074-a76b-a4ef55c74181 None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.135101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60aa79-1447-4074-a76b-a4ef55c74181 None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:53.136526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60aa79-1447-4074-a76b-a4ef55c74181 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:53.138327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 173/355] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:52 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:53.138997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60aa79-1447-4074-a76b-a4ef55c74181 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:53.147729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:53.206049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995acb84-b101-40d6-9da8-b590b2ee992e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:53.248225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db96a8-48e4-4b3f-b6fe-a4b4ba31dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:53.249108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db96a8-48e4-4b3f-b6fe-a4b4ba31dbcf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.249558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db96a8-48e4-4b3f-b6fe-a4b4ba31dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.250020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db96a8-48e4-4b3f-b6fe-a4b4ba31dbcf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.262722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db96a8-48e4-4b3f-b6fe-a4b4ba31dbcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:53.267430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60aa79-1447-4074-a76b-a4ef55c74181 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-98db96a8-48e4-4b3f-b6fe-a4b4ba31dbcf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:53.267924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:53.268776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:53.269577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 183/356] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:53.270412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52aebd-986e-460a-bbb3-2e71b64e6e35 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.270711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52aebd-986e-460a-bbb3-2e71b64e6e35 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.270938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52aebd-986e-460a-bbb3-2e71b64e6e35 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.272518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 184/357] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:53.273285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52aebd-986e-460a-bbb3-2e71b64e6e35 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:53.310871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5447678-7864-46c8-ad76-2fe65da6df99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:53.311410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5447678-7864-46c8-ad76-2fe65da6df99 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.311692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5447678-7864-46c8-ad76-2fe65da6df99 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.311961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5447678-7864-46c8-ad76-2fe65da6df99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.312740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5447678-7864-46c8-ad76-2fe65da6df99 None admin] RBAC: Adding query filter params (group.id=a52495995e0044e38aede3875f88bef4, role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:53.313045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5447678-7864-46c8-ad76-2fe65da6df99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:53.314567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5447678-7864-46c8-ad76-2fe65da6df99 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:53.321175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 174/358] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:22:53 2022] GET /identity/v3/role_assignments?group.id=a52495995e0044e38aede3875f88bef4&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:53.322439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1909fb-4f50-40a6-9b9e-cf4d35b8b005 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.322736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1909fb-4f50-40a6-9b9e-cf4d35b8b005 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.323474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1909fb-4f50-40a6-9b9e-cf4d35b8b005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.345126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bc1909fb-4f50-40a6-9b9e-cf4d35b8b005 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:53.346412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bc1909fb-4f50-40a6-9b9e-cf4d35b8b005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:53.397953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:53.411888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52aebd-986e-460a-bbb3-2e71b64e6e35 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:53.433003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:53.445256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 175/359] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:53.446336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1909fb-4f50-40a6-9b9e-cf4d35b8b005 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:53.468789 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3c66-4e4b-4f79-9fc8-33f49163cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:53.470612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3c66-4e4b-4f79-9fc8-33f49163cdcd None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.471454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3c66-4e4b-4f79-9fc8-33f49163cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.471912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3c66-4e4b-4f79-9fc8-33f49163cdcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.570265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3c66-4e4b-4f79-9fc8-33f49163cdcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:53.571659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3c66-4e4b-4f79-9fc8-33f49163cdcd None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:53.571913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1909fb-4f50-40a6-9b9e-cf4d35b8b005 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:53.620266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71104e2-318e-4478-b8ff-571d2160f819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:53.620492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71104e2-318e-4478-b8ff-571d2160f819 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.620761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71104e2-318e-4478-b8ff-571d2160f819 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.621037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71104e2-318e-4478-b8ff-571d2160f819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.622237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71104e2-318e-4478-b8ff-571d2160f819 None admin] RBAC: Adding query filter params (group.id=a52495995e0044e38aede3875f88bef4, role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:53.622551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71104e2-318e-4478-b8ff-571d2160f819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:53.624715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71104e2-318e-4478-b8ff-571d2160f819 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:53.630395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 176/360] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:22:53 2022] GET /identity/v3/role_assignments?group.id=a52495995e0044e38aede3875f88bef4&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=2fcd0ee644864d67833017de80ba1627 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:53.631442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a393f0f-22be-48af-be9a-6a91b1705962 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.631725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a393f0f-22be-48af-be9a-6a91b1705962 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.631997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a393f0f-22be-48af-be9a-6a91b1705962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.654888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2a393f0f-22be-48af-be9a-6a91b1705962 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:53.656732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2a393f0f-22be-48af-be9a-6a91b1705962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:53.701878 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:53.708876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 185/361] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:53.710804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3c66-4e4b-4f79-9fc8-33f49163cdcd None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:53.730481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:53.760803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 177/362] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:53.761732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a393f0f-22be-48af-be9a-6a91b1705962 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:53.847326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3c66-4e4b-4f79-9fc8-33f49163cdcd None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:53.894693 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dc728-16d8-4223-b86d-5754a3680e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:53.895579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dc728-16d8-4223-b86d-5754a3680e16 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.895857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dc728-16d8-4223-b86d-5754a3680e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.896279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dc728-16d8-4223-b86d-5754a3680e16 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.897290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dc728-16d8-4223-b86d-5754a3680e16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:53.897621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dc728-16d8-4223-b86d-5754a3680e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:53.899517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dc728-16d8-4223-b86d-5754a3680e16 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:53.913426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 186/363] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:53.914803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dc728-16d8-4223-b86d-5754a3680e16 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:53.920202 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a393f0f-22be-48af-be9a-6a91b1705962 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:53.959774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f027b35-3b1c-4264-8093-3fcf368d93ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:53.961400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f027b35-3b1c-4264-8093-3fcf368d93ec None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:53.961853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f027b35-3b1c-4264-8093-3fcf368d93ec None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:53.962291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f027b35-3b1c-4264-8093-3fcf368d93ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:53.974681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f027b35-3b1c-4264-8093-3fcf368d93ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-8f027b35-3b1c-4264-8093-3fcf368d93ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:53.982564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:53.983453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:53.984232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:53.987142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 178/364] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:53.991495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f027b35-3b1c-4264-8093-3fcf368d93ec None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:54.011176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:54.037633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dc728-16d8-4223-b86d-5754a3680e16 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:54.037832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:54.084851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be8a9b-37ba-46fd-a083-8fe1e76d4b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:54.086106 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be8a9b-37ba-46fd-a083-8fe1e76d4b75 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:54.086445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be8a9b-37ba-46fd-a083-8fe1e76d4b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:54.086715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be8a9b-37ba-46fd-a083-8fe1e76d4b75 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:54.087879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be8a9b-37ba-46fd-a083-8fe1e76d4b75 None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:54.090002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be8a9b-37ba-46fd-a083-8fe1e76d4b75 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:54.091485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 187/365] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:53 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:54.092252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be8a9b-37ba-46fd-a083-8fe1e76d4b75 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:54.131658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f027b35-3b1c-4264-8093-3fcf368d93ec None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:54.174150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95407e3-8123-4c44-a89a-55ff7703e923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:54.175236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95407e3-8123-4c44-a89a-55ff7703e923 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:54.175356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95407e3-8123-4c44-a89a-55ff7703e923 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:54.175695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95407e3-8123-4c44-a89a-55ff7703e923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:54.195980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95407e3-8123-4c44-a89a-55ff7703e923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c95407e3-8123-4c44-a89a-55ff7703e923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:54.201247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:54.202340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:54.203332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:54.205895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 179/366] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:54.206937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95407e3-8123-4c44-a89a-55ff7703e923 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:54.225466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be8a9b-37ba-46fd-a083-8fe1e76d4b75 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:54.264302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd3d27-c1bf-4db0-85df-b6c9585aa729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:54.264952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd3d27-c1bf-4db0-85df-b6c9585aa729 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:54.265231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd3d27-c1bf-4db0-85df-b6c9585aa729 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:54.265535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd3d27-c1bf-4db0-85df-b6c9585aa729 None admin] PATH_INFO: `/v3/users/c090a5039fc84c859faea753c3aad0f8` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:54.266815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd3d27-c1bf-4db0-85df-b6c9585aa729 None admin] RBAC: Authorizing `identity:get_user(user_id=c090a5039fc84c859faea753c3aad0f8)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:54.268266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd3d27-c1bf-4db0-85df-b6c9585aa729 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:54.275183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 188/367] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:22:54 2022] GET /identity/v3/users/c090a5039fc84c859faea753c3aad0f8 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:54.275183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd3d27-c1bf-4db0-85df-b6c9585aa729 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:54.289385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:54.312692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:54.326215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95407e3-8123-4c44-a89a-55ff7703e923 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:54.368675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e4ea-8b9b-4e83-8ebc-a90fe6f3ff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:54.369302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e4ea-8b9b-4e83-8ebc-a90fe6f3ff9d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:54.369714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e4ea-8b9b-4e83-8ebc-a90fe6f3ff9d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:54.369994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e4ea-8b9b-4e83-8ebc-a90fe6f3ff9d None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:54.370740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e4ea-8b9b-4e83-8ebc-a90fe6f3ff9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:54.371296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e4ea-8b9b-4e83-8ebc-a90fe6f3ff9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:54.372514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e4ea-8b9b-4e83-8ebc-a90fe6f3ff9d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:54.382600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 180/368] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:54.383442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e4ea-8b9b-4e83-8ebc-a90fe6f3ff9d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:54.391708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd3d27-c1bf-4db0-85df-b6c9585aa729 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:54.429233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef580534-95a1-434a-974d-00425ba04920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:54.430148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef580534-95a1-434a-974d-00425ba04920 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:54.430619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef580534-95a1-434a-974d-00425ba04920 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:54.431033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef580534-95a1-434a-974d-00425ba04920 None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:54.432332 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef580534-95a1-434a-974d-00425ba04920 None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:54.434220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef580534-95a1-434a-974d-00425ba04920 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:54.436319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 189/369] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:54 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:54.437341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef580534-95a1-434a-974d-00425ba04920 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:54.496132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e4ea-8b9b-4e83-8ebc-a90fe6f3ff9d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:54.533111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f610-1c74-475d-ac2f-37d49d43a854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:54.533765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f610-1c74-475d-ac2f-37d49d43a854 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:54.534046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f610-1c74-475d-ac2f-37d49d43a854 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:54.534323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f610-1c74-475d-ac2f-37d49d43a854 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:54.535040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449f610-1c74-475d-ac2f-37d49d43a854 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:54.535343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449f610-1c74-475d-ac2f-37d49d43a854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:54.536723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449f610-1c74-475d-ac2f-37d49d43a854 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:54.543729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:54.545981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 181/370] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:54.546927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f610-1c74-475d-ac2f-37d49d43a854 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:54.564570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:54.573561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef580534-95a1-434a-974d-00425ba04920 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:54.613147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628f120-d51c-43ab-91c6-9bc6e8032ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:54.614059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f120-d51c-43ab-91c6-9bc6e8032ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:54.614512 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f120-d51c-43ab-91c6-9bc6e8032ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:54.615053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628f120-d51c-43ab-91c6-9bc6e8032ba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:54.616127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628f120-d51c-43ab-91c6-9bc6e8032ba5 None admin] RBAC: Adding query filter params (role.id=127662cbe07e4d75a303f7c70bca2244, user.id=c090a5039fc84c859faea753c3aad0f8, scope.system=all) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:54.617126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628f120-d51c-43ab-91c6-9bc6e8032ba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:54.618695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628f120-d51c-43ab-91c6-9bc6e8032ba5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:54.638068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 190/371] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Aug 4 02:22:54 2022] GET /identity/v3/role_assignments?user.id=c090a5039fc84c859faea753c3aad0f8&scope.system=all&role.id=127662cbe07e4d75a303f7c70bca2244 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:54.638068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628f120-d51c-43ab-91c6-9bc6e8032ba5 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:54.701479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f610-1c74-475d-ac2f-37d49d43a854 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:54.745824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8104093-e95b-4ef5-a7f5-34a2d2cfddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:54.746563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104093-e95b-4ef5-a7f5-34a2d2cfddbc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:54.746844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104093-e95b-4ef5-a7f5-34a2d2cfddbc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:54.747114 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8104093-e95b-4ef5-a7f5-34a2d2cfddbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:54.836614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628f120-d51c-43ab-91c6-9bc6e8032ba5 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:54.848473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8104093-e95b-4ef5-a7f5-34a2d2cfddbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:54.849978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8104093-e95b-4ef5-a7f5-34a2d2cfddbc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:54.869171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:54.921146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677658b0-9269-483b-87ac-dcca2358e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:54.922149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677658b0-9269-483b-87ac-dcca2358e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:54.922648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677658b0-9269-483b-87ac-dcca2358e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:54.923120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677658b0-9269-483b-87ac-dcca2358e2b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:54.924235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677658b0-9269-483b-87ac-dcca2358e2b0 None admin] RBAC: Adding query filter params (group.id=a52495995e0044e38aede3875f88bef4, role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=6936fde9a1084ca0af66359685e524bb) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:54.924847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677658b0-9269-483b-87ac-dcca2358e2b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:54.926717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677658b0-9269-483b-87ac-dcca2358e2b0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:54.935578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 191/372] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:22:54 2022] GET /identity/v3/role_assignments?group.id=a52495995e0044e38aede3875f88bef4&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=2fcd0ee644864d67833017de80ba1627 => generated 260 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:54.936870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677658b0-9269-483b-87ac-dcca2358e2b0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:54.947398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:55.014634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 182/373] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:55.021040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8104093-e95b-4ef5-a7f5-34a2d2cfddbc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:55.172383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677658b0-9269-483b-87ac-dcca2358e2b0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:55.212706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8104093-e95b-4ef5-a7f5-34a2d2cfddbc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:55.215288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aecb6-6c88-4e2d-9e3a-0cff9045f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:55.215929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aecb6-6c88-4e2d-9e3a-0cff9045f3dd None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:55.216208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aecb6-6c88-4e2d-9e3a-0cff9045f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:55.216480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aecb6-6c88-4e2d-9e3a-0cff9045f3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:55.233692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:55.272295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482e8a6-1ef1-4c8c-8209-fff9ed76d08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:55.274650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482e8a6-1ef1-4c8c-8209-fff9ed76d08f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:55.274927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482e8a6-1ef1-4c8c-8209-fff9ed76d08f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:55.275197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482e8a6-1ef1-4c8c-8209-fff9ed76d08f None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:55.277217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482e8a6-1ef1-4c8c-8209-fff9ed76d08f None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:55.279310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482e8a6-1ef1-4c8c-8209-fff9ed76d08f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:55.289376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 183/374] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:55 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:55.290649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482e8a6-1ef1-4c8c-8209-fff9ed76d08f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:55.359871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8aecb6-6c88-4e2d-9e3a-0cff9045f3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:55.361407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8aecb6-6c88-4e2d-9e3a-0cff9045f3dd None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:55.366607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:55.456883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482e8a6-1ef1-4c8c-8209-fff9ed76d08f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:55.493530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e993-1d57-44ed-9990-17e686126774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:55.494489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e993-1d57-44ed-9990-17e686126774 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:55.494918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e993-1d57-44ed-9990-17e686126774 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:55.495361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e993-1d57-44ed-9990-17e686126774 None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:55.496787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e993-1d57-44ed-9990-17e686126774 None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:55.498520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e993-1d57-44ed-9990-17e686126774 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:55.500797 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 184/375] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:55 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:55.515513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e993-1d57-44ed-9990-17e686126774 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:55.527148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 192/376] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:22:55.562201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aecb6-6c88-4e2d-9e3a-0cff9045f3dd None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:55.598618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:55.697618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e993-1d57-44ed-9990-17e686126774 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:55.729165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aecb6-6c88-4e2d-9e3a-0cff9045f3dd None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:55.731119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:55.747940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba63e5-e312-4b9c-aaad-9f12a5296464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:55.749164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba63e5-e312-4b9c-aaad-9f12a5296464 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:55.749691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba63e5-e312-4b9c-aaad-9f12a5296464 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:55.750153 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba63e5-e312-4b9c-aaad-9f12a5296464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:55.751133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba63e5-e312-4b9c-aaad-9f12a5296464 None admin] RBAC: Adding query filter params (group.id=a52495995e0044e38aede3875f88bef4, role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=6936fde9a1084ca0af66359685e524bb) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:55.751691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba63e5-e312-4b9c-aaad-9f12a5296464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:55.753390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba63e5-e312-4b9c-aaad-9f12a5296464 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:55.760751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 185/377] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:22:55 2022] GET /identity/v3/role_assignments?group.id=a52495995e0044e38aede3875f88bef4&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:55.762278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3a614-f70d-4ff9-b33f-eb6b135296e1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:55.762756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3a614-f70d-4ff9-b33f-eb6b135296e1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:55.763236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3a614-f70d-4ff9-b33f-eb6b135296e1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:55.766164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 186/378] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:55.772050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2693-212a-4f06-8733-c5ac90d32507 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:55.772741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2693-212a-4f06-8733-c5ac90d32507 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:55.773727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2693-212a-4f06-8733-c5ac90d32507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:55.774187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abd317-f897-4f24-bc6b-f5f3b774d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:55.774854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abd317-f897-4f24-bc6b-f5f3b774d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:55.775137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abd317-f897-4f24-bc6b-f5f3b774d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:55.775416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abd317-f897-4f24-bc6b-f5f3b774d6b9 None admin] PATH_INFO: `/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:55.776695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abd317-f897-4f24-bc6b-f5f3b774d6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=bfeabf1f8bfc459e9c6e85a4b8e64db7)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:55.778213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abd317-f897-4f24-bc6b-f5f3b774d6b9 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:55.780572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 193/379] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:55 2022] GET /identity/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:55.786974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abd317-f897-4f24-bc6b-f5f3b774d6b9 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:55.798787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-383c2693-212a-4f06-8733-c5ac90d32507 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:55.800397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-383c2693-212a-4f06-8733-c5ac90d32507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:55.919033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 187/380] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:55.943309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2693-212a-4f06-8733-c5ac90d32507 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:56.004338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:56.031594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abd317-f897-4f24-bc6b-f5f3b774d6b9 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:56.071407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2693-212a-4f06-8733-c5ac90d32507 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:56.113610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d5d6e-dce6-46df-8f1f-5ef18bd97e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:56.114267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d5d6e-dce6-46df-8f1f-5ef18bd97e58 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.114549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d5d6e-dce6-46df-8f1f-5ef18bd97e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.114826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d5d6e-dce6-46df-8f1f-5ef18bd97e58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.118409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3025c-3863-463f-ae32-90deff8ec82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:56.119050 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3025c-3863-463f-ae32-90deff8ec82f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.119325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3025c-3863-463f-ae32-90deff8ec82f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.119600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3025c-3863-463f-ae32-90deff8ec82f None admin] PATH_INFO: `/v3/groups/7ccdcf287a2746328e93b27fe5a98611` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.131651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3025c-3863-463f-ae32-90deff8ec82f None admin] RBAC: Authorizing `identity:get_group(group_id=7ccdcf287a2746328e93b27fe5a98611)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:56.133717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3025c-3863-463f-ae32-90deff8ec82f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:56.135406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 194/381] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:55 2022] GET /identity/v3/groups/7ccdcf287a2746328e93b27fe5a98611 => generated 229 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:56.139941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d5d6e-dce6-46df-8f1f-5ef18bd97e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-307d5d6e-dce6-46df-8f1f-5ef18bd97e58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:56.144922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:56.145855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:56.146682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:56.147305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3025c-3863-463f-ae32-90deff8ec82f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:56.147894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 188/382] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:56.158293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d5d6e-dce6-46df-8f1f-5ef18bd97e58 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:56.207459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:56.296169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3025c-3863-463f-ae32-90deff8ec82f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:56.312470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d5d6e-dce6-46df-8f1f-5ef18bd97e58 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:56.314817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:56.339033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e1406-ffd9-4150-80be-698ff6c97b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:56.339829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1406-ffd9-4150-80be-698ff6c97b77 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.340220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1406-ffd9-4150-80be-698ff6c97b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.340676 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1406-ffd9-4150-80be-698ff6c97b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.341536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1406-ffd9-4150-80be-698ff6c97b77 None admin] RBAC: Adding query filter params (group.id=7ccdcf287a2746328e93b27fe5a98611, role.id=999cac3070e64b82b981258349005963, scope.project.id=bfeabf1f8bfc459e9c6e85a4b8e64db7) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:56.341912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1406-ffd9-4150-80be-698ff6c97b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:56.343531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1406-ffd9-4150-80be-698ff6c97b77 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:56.351823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 195/383] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:22:56 2022] GET /identity/v3/role_assignments?group.id=7ccdcf287a2746328e93b27fe5a98611&scope.project.id=bfeabf1f8bfc459e9c6e85a4b8e64db7&role.id=999cac3070e64b82b981258349005963 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:56.353389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f5720-a4af-47ae-a092-82b3a5370113 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.353754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f5720-a4af-47ae-a092-82b3a5370113 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.354114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f5720-a4af-47ae-a092-82b3a5370113 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.356896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f51c6-9a14-4632-b1fc-a052d11b8e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:56.357566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f51c6-9a14-4632-b1fc-a052d11b8e5e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.357846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f51c6-9a14-4632-b1fc-a052d11b8e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.358119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f51c6-9a14-4632-b1fc-a052d11b8e5e None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.358857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f51c6-9a14-4632-b1fc-a052d11b8e5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:56.359155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f51c6-9a14-4632-b1fc-a052d11b8e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:56.359826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 196/384] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:56.360583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f51c6-9a14-4632-b1fc-a052d11b8e5e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:56.363356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269054e-35c6-4e6a-9c3f-d9972b991419 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.363695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269054e-35c6-4e6a-9c3f-d9972b991419 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.363979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269054e-35c6-4e6a-9c3f-d9972b991419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.371309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 189/385] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:56.377970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f51c6-9a14-4632-b1fc-a052d11b8e5e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:56.390204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8269054e-35c6-4e6a-9c3f-d9972b991419 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:56.391480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8269054e-35c6-4e6a-9c3f-d9972b991419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:56.485489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 197/386] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:56.506517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269054e-35c6-4e6a-9c3f-d9972b991419 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:56.513320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f51c6-9a14-4632-b1fc-a052d11b8e5e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:56.540561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:56.554925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3b174-f355-4850-a5e2-862f742d5dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:56.554925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3b174-f355-4850-a5e2-862f742d5dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.555573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3b174-f355-4850-a5e2-862f742d5dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.555853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3b174-f355-4850-a5e2-862f742d5dd8 None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.565352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3b174-f355-4850-a5e2-862f742d5dd8 None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:56.565352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3b174-f355-4850-a5e2-862f742d5dd8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:56.565352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 190/387] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:56 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:56.566451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3b174-f355-4850-a5e2-862f742d5dd8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:56.604011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:56.631061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269054e-35c6-4e6a-9c3f-d9972b991419 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:56.669187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f6960-b5e0-4d3b-af54-c37a5fe52e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:56.669870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f6960-b5e0-4d3b-af54-c37a5fe52e0b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.670148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f6960-b5e0-4d3b-af54-c37a5fe52e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.670466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f6960-b5e0-4d3b-af54-c37a5fe52e0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.681827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f6960-b5e0-4d3b-af54-c37a5fe52e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:56.682976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3b174-f355-4850-a5e2-862f742d5dd8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d58f6960-b5e0-4d3b-af54-c37a5fe52e0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:56.686907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:56.687760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:56.688535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:22:56.691249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 198/388] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:22:56.694209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f6960-b5e0-4d3b-af54-c37a5fe52e0b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:56.719888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecca27-a5af-4d6c-8b74-8ba0aab1681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:56.720529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecca27-a5af-4d6c-8b74-8ba0aab1681e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.720806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecca27-a5af-4d6c-8b74-8ba0aab1681e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.721357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecca27-a5af-4d6c-8b74-8ba0aab1681e None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.723036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecca27-a5af-4d6c-8b74-8ba0aab1681e None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:56.724882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecca27-a5af-4d6c-8b74-8ba0aab1681e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:56.728127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 191/389] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:56 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:56.733634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecca27-a5af-4d6c-8b74-8ba0aab1681e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:56.795242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:56.808313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f6960-b5e0-4d3b-af54-c37a5fe52e0b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:56.839433 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:56.843327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecca27-a5af-4d6c-8b74-8ba0aab1681e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:56.848050 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079af0d8-bc49-4968-80c0-53f538d6bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:56.848680 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af0d8-bc49-4968-80c0-53f538d6bc09 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.848958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af0d8-bc49-4968-80c0-53f538d6bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.849227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079af0d8-bc49-4968-80c0-53f538d6bc09 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.849993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079af0d8-bc49-4968-80c0-53f538d6bc09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:56.850297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079af0d8-bc49-4968-80c0-53f538d6bc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:56.852358 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079af0d8-bc49-4968-80c0-53f538d6bc09 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:56.866073 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 199/390] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:56.868707 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079af0d8-bc49-4968-80c0-53f538d6bc09 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:56.881723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b992-f0df-4f78-97ca-bf88703a5abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:56.882442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b992-f0df-4f78-97ca-bf88703a5abf None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:56.882722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b992-f0df-4f78-97ca-bf88703a5abf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:56.882999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b992-f0df-4f78-97ca-bf88703a5abf None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/groups/a52495995e0044e38aede3875f88bef4/roles/9bd0594bb1684b5eaa192f6669a7fc36` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:56.885248 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644b992-f0df-4f78-97ca-bf88703a5abf None admin] RBAC: Authorizing `identity:create_grant(project_id=7401ba8e38da408d810d1c3f4f7334d5, group_id=a52495995e0044e38aede3875f88bef4, role_id=9bd0594bb1684b5eaa192f6669a7fc36)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:56.886726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644b992-f0df-4f78-97ca-bf88703a5abf None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:56.907378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 192/391] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Aug 4 02:22:56 2022] PUT /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/groups/a52495995e0044e38aede3875f88bef4/roles/9bd0594bb1684b5eaa192f6669a7fc36 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:22:56.988962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079af0d8-bc49-4968-80c0-53f538d6bc09 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:57.026876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1e19f-4ff2-4be9-b55b-e03f3b7dafdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:57.027531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1e19f-4ff2-4be9-b55b-e03f3b7dafdf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:57.027811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1e19f-4ff2-4be9-b55b-e03f3b7dafdf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:57.028086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1e19f-4ff2-4be9-b55b-e03f3b7dafdf None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:57.029354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1e19f-4ff2-4be9-b55b-e03f3b7dafdf None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:57.031095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1e19f-4ff2-4be9-b55b-e03f3b7dafdf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:57.037579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 200/392] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:56 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:57.040243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b992-f0df-4f78-97ca-bf88703a5abf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:57.177271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b992-f0df-4f78-97ca-bf88703a5abf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:57.214737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4bf53-5f50-4409-80c5-fd3c0291a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:57.215374 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4bf53-5f50-4409-80c5-fd3c0291a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:57.215654 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4bf53-5f50-4409-80c5-fd3c0291a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:57.215928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4bf53-5f50-4409-80c5-fd3c0291a1e6 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:57.217089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4bf53-5f50-4409-80c5-fd3c0291a1e6 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:57.218565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4bf53-5f50-4409-80c5-fd3c0291a1e6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:57.220535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 193/393] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:57 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:57.226574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1e19f-4ff2-4be9-b55b-e03f3b7dafdf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:57.247095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:57.348616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1e19f-4ff2-4be9-b55b-e03f3b7dafdf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:57.396715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770615df-128d-4ef0-8400-bf95b84f52f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:57.397432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770615df-128d-4ef0-8400-bf95b84f52f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:57.397743 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770615df-128d-4ef0-8400-bf95b84f52f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:57.398112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770615df-128d-4ef0-8400-bf95b84f52f3 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/groups/a52495995e0044e38aede3875f88bef4/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:57.400188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770615df-128d-4ef0-8400-bf95b84f52f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7401ba8e38da408d810d1c3f4f7334d5, group_id=a52495995e0044e38aede3875f88bef4, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:57.401672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770615df-128d-4ef0-8400-bf95b84f52f3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:57.427504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 201/394] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Aug 4 02:22:57 2022] PUT /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5/groups/a52495995e0044e38aede3875f88bef4/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:57.816353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3ea12-2b02-448d-8ee8-185793d0df4b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:57.817437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3ea12-2b02-448d-8ee8-185793d0df4b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:57.817929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3ea12-2b02-448d-8ee8-185793d0df4b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:57.820254 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 194/395] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:57.825519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d24dd-624a-488c-baa8-17c840df2148 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:57.825807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d24dd-624a-488c-baa8-17c840df2148 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:57.826087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d24dd-624a-488c-baa8-17c840df2148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:57.849537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f18d24dd-624a-488c-baa8-17c840df2148 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:57.850752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f18d24dd-624a-488c-baa8-17c840df2148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:57.935796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 202/396] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:57.974107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3ea12-2b02-448d-8ee8-185793d0df4b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:58.013093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:58.111231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3ea12-2b02-448d-8ee8-185793d0df4b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:58.160499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaddc4a-271f-436a-8909-80eadd93a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:58.161143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaddc4a-271f-436a-8909-80eadd93a276 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.161441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaddc4a-271f-436a-8909-80eadd93a276 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.161712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaddc4a-271f-436a-8909-80eadd93a276 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.177057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaddc4a-271f-436a-8909-80eadd93a276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-beaddc4a-271f-436a-8909-80eadd93a276 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:58.183055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:58.183911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:58.184778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 195/397] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:58.189962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d24dd-624a-488c-baa8-17c840df2148 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:58.204992 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:58.312340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d24dd-624a-488c-baa8-17c840df2148 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:58.347038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2aa14a-e217-4aa0-b692-71a19f747f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:58.347698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aa14a-e217-4aa0-b692-71a19f747f48 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.347979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aa14a-e217-4aa0-b692-71a19f747f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.348246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2aa14a-e217-4aa0-b692-71a19f747f48 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.348952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2aa14a-e217-4aa0-b692-71a19f747f48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:58.349251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2aa14a-e217-4aa0-b692-71a19f747f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:58.350672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2aa14a-e217-4aa0-b692-71a19f747f48 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:58.359468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 203/398] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:22:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:58.367009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaddc4a-271f-436a-8909-80eadd93a276 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:58.479487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:58.494366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaddc4a-271f-436a-8909-80eadd93a276 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:58.540439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f6ff1-1e94-4233-8f76-fc649fa7d22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:58.541089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f6ff1-1e94-4233-8f76-fc649fa7d22c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.541385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f6ff1-1e94-4233-8f76-fc649fa7d22c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.541662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f6ff1-1e94-4233-8f76-fc649fa7d22c None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.542819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f6ff1-1e94-4233-8f76-fc649fa7d22c None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:58.544491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f6ff1-1e94-4233-8f76-fc649fa7d22c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:58.545949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879cee3-8481-44c3-929e-43304617fa3a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.546295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879cee3-8481-44c3-929e-43304617fa3a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.546563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879cee3-8481-44c3-929e-43304617fa3a None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.547848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 196/399] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:58 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:58.548169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 204/400] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:22:58.555766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f6ff1-1e94-4233-8f76-fc649fa7d22c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:58.559433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679cbd2-d801-4394-8db1-e679287890c1 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.559717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679cbd2-d801-4394-8db1-e679287890c1 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.559989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679cbd2-d801-4394-8db1-e679287890c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.584441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4679cbd2-d801-4394-8db1-e679287890c1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:58.585993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4679cbd2-d801-4394-8db1-e679287890c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:58.657774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 205/401] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:58.658047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:58.668824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188ff46-d226-43a6-b88a-dcb63e7b21e8 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.669127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188ff46-d226-43a6-b88a-dcb63e7b21e8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.669619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188ff46-d226-43a6-b88a-dcb63e7b21e8 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.671445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 206/402] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:58.676468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c31bf-5d6e-49cb-84a8-7e9109ce5ad0 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.676875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c31bf-5d6e-49cb-84a8-7e9109ce5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.677390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c31bf-5d6e-49cb-84a8-7e9109ce5ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.681882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f6ff1-1e94-4233-8f76-fc649fa7d22c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:58.706881 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-102c31bf-5d6e-49cb-84a8-7e9109ce5ad0 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:58.708652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-102c31bf-5d6e-49cb-84a8-7e9109ce5ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:58.716373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d82c8-26d3-43c9-8d04-b4988e9ec17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:58.717017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d82c8-26d3-43c9-8d04-b4988e9ec17a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.717299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d82c8-26d3-43c9-8d04-b4988e9ec17a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.717601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d82c8-26d3-43c9-8d04-b4988e9ec17a None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.718757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d82c8-26d3-43c9-8d04-b4988e9ec17a None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:58.720186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d82c8-26d3-43c9-8d04-b4988e9ec17a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:58.722262 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 197/403] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:58 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:58.723041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d82c8-26d3-43c9-8d04-b4988e9ec17a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:58.749390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:58.784875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 207/404] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:22:58.786125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c31bf-5d6e-49cb-84a8-7e9109ce5ad0 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:58.825987 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d82c8-26d3-43c9-8d04-b4988e9ec17a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:58.861072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de554e-d763-40d7-a8a0-7b9ad6503b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:58.861498 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de554e-d763-40d7-a8a0-7b9ad6503b8a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.861778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de554e-d763-40d7-a8a0-7b9ad6503b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.862050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de554e-d763-40d7-a8a0-7b9ad6503b8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.873183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de554e-d763-40d7-a8a0-7b9ad6503b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-53de554e-d763-40d7-a8a0-7b9ad6503b8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:58.878530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:58.879606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:58.880416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 198/405] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:58.881083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de554e-d763-40d7-a8a0-7b9ad6503b8a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:58.895467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c31bf-5d6e-49cb-84a8-7e9109ce5ad0 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:58.931100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:58.935869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb0155-427a-4736-9e10-380e6d430ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:58.936775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb0155-427a-4736-9e10-380e6d430ba1 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:58.937229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb0155-427a-4736-9e10-380e6d430ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:58.938018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb0155-427a-4736-9e10-380e6d430ba1 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb/groups/a52495995e0044e38aede3875f88bef4/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:58.940865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb0155-427a-4736-9e10-380e6d430ba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6936fde9a1084ca0af66359685e524bb, group_id=a52495995e0044e38aede3875f88bef4, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:58.943427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb0155-427a-4736-9e10-380e6d430ba1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:58.963408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 208/406] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Aug 4 02:22:58 2022] PUT /identity/v3/projects/6936fde9a1084ca0af66359685e524bb/groups/a52495995e0044e38aede3875f88bef4/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:58.965177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb0155-427a-4736-9e10-380e6d430ba1 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:58.983053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:59.008038 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de554e-d763-40d7-a8a0-7b9ad6503b8a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:59.053603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d217f0-c8bc-4ff0-9a61-81c462f25297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:59.055091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d217f0-c8bc-4ff0-9a61-81c462f25297 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.055550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d217f0-c8bc-4ff0-9a61-81c462f25297 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.055988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d217f0-c8bc-4ff0-9a61-81c462f25297 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.075470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d217f0-c8bc-4ff0-9a61-81c462f25297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-84d217f0-c8bc-4ff0-9a61-81c462f25297 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:22:59.080419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:22:59.081474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:22:59.082446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 199/407] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:22:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:22:59.089393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d217f0-c8bc-4ff0-9a61-81c462f25297 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:59.111872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb0155-427a-4736-9e10-380e6d430ba1 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:59.207617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67947aa-a58a-4df4-96ad-2028645560f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:59.208159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67947aa-a58a-4df4-96ad-2028645560f7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.208437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67947aa-a58a-4df4-96ad-2028645560f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.208706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67947aa-a58a-4df4-96ad-2028645560f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.210141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67947aa-a58a-4df4-96ad-2028645560f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:59.210552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67947aa-a58a-4df4-96ad-2028645560f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:59.211911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67947aa-a58a-4df4-96ad-2028645560f7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:59.221506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 209/408] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:22:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:59.226659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67947aa-a58a-4df4-96ad-2028645560f7 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:59.235579 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d217f0-c8bc-4ff0-9a61-81c462f25297 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:59.277381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0b67d-8e26-465f-b8f6-68052eac415c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:59.278147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0b67d-8e26-465f-b8f6-68052eac415c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.278431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0b67d-8e26-465f-b8f6-68052eac415c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.278807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0b67d-8e26-465f-b8f6-68052eac415c None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.279515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0b67d-8e26-465f-b8f6-68052eac415c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:22:59.279815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0b67d-8e26-465f-b8f6-68052eac415c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:59.281595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0b67d-8e26-465f-b8f6-68052eac415c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:59.285291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:59.292845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 200/409] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:59.299178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0b67d-8e26-465f-b8f6-68052eac415c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:59.310555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:59.379461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67947aa-a58a-4df4-96ad-2028645560f7 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:59.417086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0b67d-8e26-465f-b8f6-68052eac415c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:59.446714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de214d2-1e3f-463c-a5ef-103e63cd37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:59.447355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de214d2-1e3f-463c-a5ef-103e63cd37b5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.447638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de214d2-1e3f-463c-a5ef-103e63cd37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.447917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de214d2-1e3f-463c-a5ef-103e63cd37b5 None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.449071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de214d2-1e3f-463c-a5ef-103e63cd37b5 None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:59.450539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de214d2-1e3f-463c-a5ef-103e63cd37b5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:59.452548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 210/410] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:59 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:59.457836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de214d2-1e3f-463c-a5ef-103e63cd37b5 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:59.502615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32d31b-9552-494a-b8c4-f5399b697cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:59.503637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d31b-9552-494a-b8c4-f5399b697cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.504111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d31b-9552-494a-b8c4-f5399b697cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.504577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d31b-9552-494a-b8c4-f5399b697cd5 None admin] PATH_INFO: `/v3/groups/7ccdcf287a2746328e93b27fe5a98611` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.510011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32d31b-9552-494a-b8c4-f5399b697cd5 None admin] RBAC: Authorizing `identity:get_group(group_id=7ccdcf287a2746328e93b27fe5a98611)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:59.511708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32d31b-9552-494a-b8c4-f5399b697cd5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:59.513888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 201/411] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:22:59 2022] GET /identity/v3/groups/7ccdcf287a2746328e93b27fe5a98611 => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:59.521687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32d31b-9552-494a-b8c4-f5399b697cd5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:59.572391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de214d2-1e3f-463c-a5ef-103e63cd37b5 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:59.606055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:59.616877 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5a753-7513-42da-a256-43d0c299c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:59.618051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5a753-7513-42da-a256-43d0c299c03f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.618335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5a753-7513-42da-a256-43d0c299c03f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.618614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5a753-7513-42da-a256-43d0c299c03f None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.619872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5a753-7513-42da-a256-43d0c299c03f None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:59.628152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5a753-7513-42da-a256-43d0c299c03f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:59.628152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 211/412] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:59 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:22:59.629135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5a753-7513-42da-a256-43d0c299c03f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:59.726335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:59.740094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5a753-7513-42da-a256-43d0c299c03f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:59.755155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32d31b-9552-494a-b8c4-f5399b697cd5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:59.774657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fd054-90c7-4b3c-86b4-f5dad512744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:59.775106 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fd054-90c7-4b3c-86b4-f5dad512744f None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.775388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fd054-90c7-4b3c-86b4-f5dad512744f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.775662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fd054-90c7-4b3c-86b4-f5dad512744f None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb/groups/a52495995e0044e38aede3875f88bef4/roles/9bd0594bb1684b5eaa192f6669a7fc36` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.777867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fd054-90c7-4b3c-86b4-f5dad512744f None admin] RBAC: Authorizing `identity:create_grant(project_id=6936fde9a1084ca0af66359685e524bb, group_id=a52495995e0044e38aede3875f88bef4, role_id=9bd0594bb1684b5eaa192f6669a7fc36)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:59.779289 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fd054-90c7-4b3c-86b4-f5dad512744f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:59.796829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 212/413] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Aug 4 02:22:59 2022] PUT /identity/v3/projects/6936fde9a1084ca0af66359685e524bb/groups/a52495995e0044e38aede3875f88bef4/roles/9bd0594bb1684b5eaa192f6669a7fc36 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:22:59.799198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2790c-746d-475c-b1c1-26b471b186c0 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.799487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2790c-746d-475c-b1c1-26b471b186c0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.799768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2790c-746d-475c-b1c1-26b471b186c0 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.800831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50218b-91fd-4079-bec8-dbd8264325c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:59.801507 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 213/414] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:22:59.802208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50218b-91fd-4079-bec8-dbd8264325c1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.802596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50218b-91fd-4079-bec8-dbd8264325c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.802953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50218b-91fd-4079-bec8-dbd8264325c1 None admin] PATH_INFO: `/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.804260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50218b-91fd-4079-bec8-dbd8264325c1 None admin] RBAC: Authorizing `identity:get_project(project_id=bfeabf1f8bfc459e9c6e85a4b8e64db7)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:59.805911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50218b-91fd-4079-bec8-dbd8264325c1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:59.806933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6af57-5900-4730-9810-362d167acbbd None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.807438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6af57-5900-4730-9810-362d167acbbd None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.807908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6af57-5900-4730-9810-362d167acbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.808127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 202/415] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:22:59 2022] GET /identity/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7 => generated 344 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:22:59.814182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50218b-91fd-4079-bec8-dbd8264325c1 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:59.830075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8ef6af57-5900-4730-9810-362d167acbbd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:22:59.831686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8ef6af57-5900-4730-9810-362d167acbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:22:59.883463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:22:59.910895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 214/416] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:22:59.929144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50218b-91fd-4079-bec8-dbd8264325c1 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:22:59.946008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6af57-5900-4730-9810-362d167acbbd None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:22:59.966080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f466087-7bbb-4bc6-a3d5-02667565030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:22:59.966905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f466087-7bbb-4bc6-a3d5-02667565030e None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:22:59.967253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f466087-7bbb-4bc6-a3d5-02667565030e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:22:59.967606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f466087-7bbb-4bc6-a3d5-02667565030e None admin] PATH_INFO: `/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7/groups/7ccdcf287a2746328e93b27fe5a98611/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:22:59.969815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f466087-7bbb-4bc6-a3d5-02667565030e None admin] RBAC: Authorizing `identity:create_grant(project_id=bfeabf1f8bfc459e9c6e85a4b8e64db7, group_id=7ccdcf287a2746328e93b27fe5a98611, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:22:59.971378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f466087-7bbb-4bc6-a3d5-02667565030e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:22:59.989141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 203/417] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Aug 4 02:22:59 2022] PUT /identity/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7/groups/7ccdcf287a2746328e93b27fe5a98611/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:23:00.079520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6af57-5900-4730-9810-362d167acbbd None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:00.119481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83279df2-03e5-4a81-9b68-215506017904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:00.120445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83279df2-03e5-4a81-9b68-215506017904 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:00.120897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83279df2-03e5-4a81-9b68-215506017904 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:00.121446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83279df2-03e5-4a81-9b68-215506017904 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:00.129888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a34622-97c5-406b-aac1-27f9e5d8f105 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:00.130255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a34622-97c5-406b-aac1-27f9e5d8f105 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:00.130612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a34622-97c5-406b-aac1-27f9e5d8f105 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:00.132890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 204/418] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:00.135545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83279df2-03e5-4a81-9b68-215506017904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:00.137975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd005db7-44aa-488a-9e07-85ab97d22086 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:00.138356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd005db7-44aa-488a-9e07-85ab97d22086 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:00.138706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd005db7-44aa-488a-9e07-85ab97d22086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-83279df2-03e5-4a81-9b68-215506017904 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:00.141686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:00.142580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:23:00.143337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:00.145838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 215/419] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:22:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:00.148627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:00.151975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83279df2-03e5-4a81-9b68-215506017904 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:00.168356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cd005db7-44aa-488a-9e07-85ab97d22086 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:00.169799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cd005db7-44aa-488a-9e07-85ab97d22086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:00.199605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:00.275311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83279df2-03e5-4a81-9b68-215506017904 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:00.312556 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b919c11-1e80-4eea-8f87-51b92cbdd237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:00.313461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b919c11-1e80-4eea-8f87-51b92cbdd237 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:00.313883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b919c11-1e80-4eea-8f87-51b92cbdd237 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:00.314426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b919c11-1e80-4eea-8f87-51b92cbdd237 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:00.315278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b919c11-1e80-4eea-8f87-51b92cbdd237 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:00.315714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b919c11-1e80-4eea-8f87-51b92cbdd237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:00.317234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b919c11-1e80-4eea-8f87-51b92cbdd237 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:00.328005 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 216/420] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:00.333088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b919c11-1e80-4eea-8f87-51b92cbdd237 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:00.338116 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 205/421] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:00.382905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd005db7-44aa-488a-9e07-85ab97d22086 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:00.444909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:00.448395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b919c11-1e80-4eea-8f87-51b92cbdd237 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:00.489951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be217-9de6-4e0f-a21b-b376314c95e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:00.491321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be217-9de6-4e0f-a21b-b376314c95e8 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:00.491745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be217-9de6-4e0f-a21b-b376314c95e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:00.492159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be217-9de6-4e0f-a21b-b376314c95e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:00.572143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459be217-9de6-4e0f-a21b-b376314c95e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:00.573968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459be217-9de6-4e0f-a21b-b376314c95e8 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:00.623339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd005db7-44aa-488a-9e07-85ab97d22086 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:00.683370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 217/422] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:00.684392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:00.690764 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be217-9de6-4e0f-a21b-b376314c95e8 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:00.709006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:00.718052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1be7a7-a4a7-4177-a67c-65a0303a26c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:00.718700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1be7a7-a4a7-4177-a67c-65a0303a26c8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:00.718979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1be7a7-a4a7-4177-a67c-65a0303a26c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:00.719251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1be7a7-a4a7-4177-a67c-65a0303a26c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:00.739184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1be7a7-a4a7-4177-a67c-65a0303a26c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ea1be7a7-a4a7-4177-a67c-65a0303a26c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:00.744122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:00.744985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:23:00.745787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:00.746371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 206/423] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:00.750905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1be7a7-a4a7-4177-a67c-65a0303a26c8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:00.891812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be217-9de6-4e0f-a21b-b376314c95e8 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:00.893291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1be7a7-a4a7-4177-a67c-65a0303a26c8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:00.927319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283093-032f-4267-adea-6cea9705796f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:00.927960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283093-032f-4267-adea-6cea9705796f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:00.928242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283093-032f-4267-adea-6cea9705796f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:00.928519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89283093-032f-4267-adea-6cea9705796f None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:00.929755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89283093-032f-4267-adea-6cea9705796f None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:00.931191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89283093-032f-4267-adea-6cea9705796f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:00.933143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 218/424] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:23:00 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:00.946233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283093-032f-4267-adea-6cea9705796f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:00.948760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b5f2-65cd-4f0e-aab4-7e458418d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:00.949404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b5f2-65cd-4f0e-aab4-7e458418d7dc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:00.949754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b5f2-65cd-4f0e-aab4-7e458418d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:00.949953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b5f2-65cd-4f0e-aab4-7e458418d7dc None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:00.950659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b5f2-65cd-4f0e-aab4-7e458418d7dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:00.950954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b5f2-65cd-4f0e-aab4-7e458418d7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:00.952326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b5f2-65cd-4f0e-aab4-7e458418d7dc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:00.962076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 207/425] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:00.970561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b5f2-65cd-4f0e-aab4-7e458418d7dc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:01.072010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:01.084163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:01.120069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89283093-032f-4267-adea-6cea9705796f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:01.165759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15bea8-f11a-4c2d-804f-89b66022dac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:01.166730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15bea8-f11a-4c2d-804f-89b66022dac0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:01.167201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15bea8-f11a-4c2d-804f-89b66022dac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:01.167664 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15bea8-f11a-4c2d-804f-89b66022dac0 None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:01.169051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15bea8-f11a-4c2d-804f-89b66022dac0 None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:01.171451 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15bea8-f11a-4c2d-804f-89b66022dac0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:01.173809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 219/426] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:23:00 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:01.180054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15bea8-f11a-4c2d-804f-89b66022dac0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:01.191473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b5f2-65cd-4f0e-aab4-7e458418d7dc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:01.279330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe5657-549f-4e4a-b974-80096bee83ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:01.281588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe5657-549f-4e4a-b974-80096bee83ad None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:01.282279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe5657-549f-4e4a-b974-80096bee83ad None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:01.283768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe5657-549f-4e4a-b974-80096bee83ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:01.320866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15bea8-f11a-4c2d-804f-89b66022dac0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:01.356043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22342469-a20d-4055-b929-dec3b69376b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:01.356666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22342469-a20d-4055-b929-dec3b69376b3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:01.356950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22342469-a20d-4055-b929-dec3b69376b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:01.357228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22342469-a20d-4055-b929-dec3b69376b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:01.358049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22342469-a20d-4055-b929-dec3b69376b3 None admin] RBAC: Adding query filter params (group.id=a52495995e0044e38aede3875f88bef4, role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:01.358360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22342469-a20d-4055-b929-dec3b69376b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:01.360246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22342469-a20d-4055-b929-dec3b69376b3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:01.364028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:01.368924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 220/427] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:23:01 2022] GET /identity/v3/role_assignments?group.id=a52495995e0044e38aede3875f88bef4&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:01.397371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe5657-549f-4e4a-b974-80096bee83ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:01.399986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe5657-549f-4e4a-b974-80096bee83ad None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:01.480383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:01.560416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 208/428] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:01.565463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15645-7fb8-47c5-8e8e-988f158695f3 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:01.565902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15645-7fb8-47c5-8e8e-988f158695f3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:01.566036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15645-7fb8-47c5-8e8e-988f158695f3 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:01.567366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 221/429] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:01.568383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe5657-549f-4e4a-b974-80096bee83ad None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:01.581771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e73939-11d9-4305-a58d-3cb1d91be686 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:01.582072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e73939-11d9-4305-a58d-3cb1d91be686 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:01.582322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e73939-11d9-4305-a58d-3cb1d91be686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:01.615138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-28e73939-11d9-4305-a58d-3cb1d91be686 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:01.617929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-28e73939-11d9-4305-a58d-3cb1d91be686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:01.715581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe5657-549f-4e4a-b974-80096bee83ad None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:01.725180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 222/430] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:01.749179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e73939-11d9-4305-a58d-3cb1d91be686 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:01.763810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588511c-5ace-4b45-9933-a37c6ec9d103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:01.764779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588511c-5ace-4b45-9933-a37c6ec9d103 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:01.765313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588511c-5ace-4b45-9933-a37c6ec9d103 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:01.765883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588511c-5ace-4b45-9933-a37c6ec9d103 None admin] PATH_INFO: `/v3/projects/7401ba8e38da408d810d1c3f4f7334d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:01.767411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588511c-5ace-4b45-9933-a37c6ec9d103 None admin] RBAC: Authorizing `identity:get_project(project_id=7401ba8e38da408d810d1c3f4f7334d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:01.769176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588511c-5ace-4b45-9933-a37c6ec9d103 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:01.771584 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 209/431] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:23:01 2022] GET /identity/v3/projects/7401ba8e38da408d810d1c3f4f7334d5 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:01.776557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588511c-5ace-4b45-9933-a37c6ec9d103 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:01.806547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:01.878391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e73939-11d9-4305-a58d-3cb1d91be686 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:01.892812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588511c-5ace-4b45-9933-a37c6ec9d103 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:01.911642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:01.918894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09b9e-ea48-4392-b256-8809c611192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:01.919672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09b9e-ea48-4392-b256-8809c611192c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:01.919783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09b9e-ea48-4392-b256-8809c611192c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:01.920056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b09b9e-ea48-4392-b256-8809c611192c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:01.931379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b09b9e-ea48-4392-b256-8809c611192c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:01.935487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a74e-21a7-4e26-9e63-4d92fe03e9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:01.936427 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a74e-21a7-4e26-9e63-4d92fe03e9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-a4b09b9e-ea48-4392-b256-8809c611192c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:01.936694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:01.937611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:01.943400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 223/432] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:01.944074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a74e-21a7-4e26-9e63-4d92fe03e9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:01.944074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a74e-21a7-4e26-9e63-4d92fe03e9d8 None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:01.944074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51a74e-21a7-4e26-9e63-4d92fe03e9d8 None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:01.944727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51a74e-21a7-4e26-9e63-4d92fe03e9d8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:01.946139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09b9e-ea48-4392-b256-8809c611192c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:01.951514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 210/433] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:23:01 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:01.952368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a74e-21a7-4e26-9e63-4d92fe03e9d8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:02.061052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:02.062027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b09b9e-ea48-4392-b256-8809c611192c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:02.072805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a74e-21a7-4e26-9e63-4d92fe03e9d8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:02.097495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0854a6a-859a-4dc2-9e7c-f25e8b405f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:02.098113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854a6a-859a-4dc2-9e7c-f25e8b405f78 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.098379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854a6a-859a-4dc2-9e7c-f25e8b405f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.098649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854a6a-859a-4dc2-9e7c-f25e8b405f78 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.099353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0854a6a-859a-4dc2-9e7c-f25e8b405f78 None admin] RBAC: Adding query filter params (name=member) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:02.099652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0854a6a-859a-4dc2-9e7c-f25e8b405f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:02.101601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0854a6a-859a-4dc2-9e7c-f25e8b405f78 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:02.114501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 224/434] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:23:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:02.116323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0854a6a-859a-4dc2-9e7c-f25e8b405f78 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:02.118731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe41eb4-aa3a-4e73-a879-b077e439629d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:02.119766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe41eb4-aa3a-4e73-a879-b077e439629d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.120292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe41eb4-aa3a-4e73-a879-b077e439629d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.120768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe41eb4-aa3a-4e73-a879-b077e439629d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.121782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe41eb4-aa3a-4e73-a879-b077e439629d None admin] RBAC: Adding query filter params (group.id=a52495995e0044e38aede3875f88bef4, role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=7401ba8e38da408d810d1c3f4f7334d5) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:02.122290 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe41eb4-aa3a-4e73-a879-b077e439629d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:02.123962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe41eb4-aa3a-4e73-a879-b077e439629d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:02.131310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 211/435] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:23:01 2022] GET /identity/v3/role_assignments?group.id=a52495995e0044e38aede3875f88bef4&scope.project.id=7401ba8e38da408d810d1c3f4f7334d5&role.id=2fcd0ee644864d67833017de80ba1627 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:02.185636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:02.240713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0854a6a-859a-4dc2-9e7c-f25e8b405f78 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:02.264901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ae642-2d63-484e-a892-829a450cac52 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.265656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ae642-2d63-484e-a892-829a450cac52 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.266169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ae642-2d63-484e-a892-829a450cac52 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.268119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 212/436] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:02.275234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba744c9-472c-4b45-ac0d-f564882bdb79 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.275529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba744c9-472c-4b45-ac0d-f564882bdb79 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.275802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba744c9-472c-4b45-ac0d-f564882bdb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.285370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42fe1-6021-4746-9902-a193e4dae716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:02.286369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42fe1-6021-4746-9902-a193e4dae716 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.286865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42fe1-6021-4746-9902-a193e4dae716 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.287390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a42fe1-6021-4746-9902-a193e4dae716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.296807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3ba744c9-472c-4b45-ac0d-f564882bdb79 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:02.298201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3ba744c9-472c-4b45-ac0d-f564882bdb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:02.366635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a42fe1-6021-4746-9902-a193e4dae716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:02.368003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a42fe1-6021-4746-9902-a193e4dae716 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:02.387056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 213/437] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:02.388325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a31146-7f97-48cd-9d81-270a8492382c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.388608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a31146-7f97-48cd-9d81-270a8492382c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.388881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a31146-7f97-48cd-9d81-270a8492382c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.390319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 214/438] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:02.396369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c000201-d27b-405e-b62d-122507c7a1a8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.396776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c000201-d27b-405e-b62d-122507c7a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.398048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c000201-d27b-405e-b62d-122507c7a1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.420552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7c000201-d27b-405e-b62d-122507c7a1a8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:02.421804 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7c000201-d27b-405e-b62d-122507c7a1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:02.429420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:02.485964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 225/439] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:02.487120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42fe1-6021-4746-9902-a193e4dae716 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:02.503378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 215/440] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:02.504214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c000201-d27b-405e-b62d-122507c7a1a8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:02.525758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:02.616088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a42fe1-6021-4746-9902-a193e4dae716 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:02.630856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c000201-d27b-405e-b62d-122507c7a1a8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:02.656680 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c878c-fce2-409f-af54-369dd72c7b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:02.657429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c878c-fce2-409f-af54-369dd72c7b49 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.657659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c878c-fce2-409f-af54-369dd72c7b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.657937 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c878c-fce2-409f-af54-369dd72c7b49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.669661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c878c-fce2-409f-af54-369dd72c7b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:02.672447 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f26387-b547-4185-b832-042a49882dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:02.673087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f26387-b547-4185-b832-042a49882dda None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.673387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f26387-b547-4185-b832-042a49882dda None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.673661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f26387-b547-4185-b832-042a49882dda None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-7f4c878c-fce2-409f-af54-369dd72c7b49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:02.674626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:02.675482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:23:02.676285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:02.676877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f26387-b547-4185-b832-042a49882dda None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:02.676945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 226/441] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:02.677009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f26387-b547-4185-b832-042a49882dda None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:02.677081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c878c-fce2-409f-af54-369dd72c7b49 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:02.678194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 216/442] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:23:02 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:02.681773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f26387-b547-4185-b832-042a49882dda None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:02.693486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:02.769081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:02.780897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c878c-fce2-409f-af54-369dd72c7b49 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:02.787542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f26387-b547-4185-b832-042a49882dda None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:02.814470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f0749-20a7-4fde-881c-12757dbf514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:02.815200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f0749-20a7-4fde-881c-12757dbf514d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.815479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f0749-20a7-4fde-881c-12757dbf514d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.815752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f0749-20a7-4fde-881c-12757dbf514d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.820962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e8861-b412-4c3d-baf2-c507e4e0aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:02.821596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e8861-b412-4c3d-baf2-c507e4e0aa0c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.821878 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e8861-b412-4c3d-baf2-c507e4e0aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.822151 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e8861-b412-4c3d-baf2-c507e4e0aa0c None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.822855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e8861-b412-4c3d-baf2-c507e4e0aa0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:02.823154 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e8861-b412-4c3d-baf2-c507e4e0aa0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:02.824541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e8861-b412-4c3d-baf2-c507e4e0aa0c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:02.826341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f0749-20a7-4fde-881c-12757dbf514d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-ef7f0749-20a7-4fde-881c-12757dbf514d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:02.831328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:02.832366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:02.833222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:02.833858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 217/443] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:02.833858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e8861-b412-4c3d-baf2-c507e4e0aa0c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:02.837246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 227/444] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:02.837746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f0749-20a7-4fde-881c-12757dbf514d None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:02.906851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:02.931274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e8861-b412-4c3d-baf2-c507e4e0aa0c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:02.936419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f0749-20a7-4fde-881c-12757dbf514d None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:02.964088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdaff6-e646-4739-bec5-bbc8c3f3b181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:02.964718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdaff6-e646-4739-bec5-bbc8c3f3b181 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.964997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdaff6-e646-4739-bec5-bbc8c3f3b181 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.965271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdaff6-e646-4739-bec5-bbc8c3f3b181 None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.966432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdaff6-e646-4739-bec5-bbc8c3f3b181 None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:02.967860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdaff6-e646-4739-bec5-bbc8c3f3b181 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:02.969271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923329ef-f552-457e-9934-803e8442360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:02.969498 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 218/445] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:23:02 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:02.969912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923329ef-f552-457e-9934-803e8442360d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:02.970193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923329ef-f552-457e-9934-803e8442360d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:02.970283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdaff6-e646-4739-bec5-bbc8c3f3b181 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:02.970470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923329ef-f552-457e-9934-803e8442360d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:02.987418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:03.038102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923329ef-f552-457e-9934-803e8442360d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.039563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923329ef-f552-457e-9934-803e8442360d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.073601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdaff6-e646-4739-bec5-bbc8c3f3b181 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:03.105181 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:03.106040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54ffde-288c-4391-9271-450013860308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:03.106644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54ffde-288c-4391-9271-450013860308 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:03.107023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54ffde-288c-4391-9271-450013860308 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:03.107319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54ffde-288c-4391-9271-450013860308 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:03.108069 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54ffde-288c-4391-9271-450013860308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:03.108372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54ffde-288c-4391-9271-450013860308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.109768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54ffde-288c-4391-9271-450013860308 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.118753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 219/446] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:03.119566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54ffde-288c-4391-9271-450013860308 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:03.140786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 228/447] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:03.141637 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923329ef-f552-457e-9934-803e8442360d None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:03.196774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:03.220770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54ffde-288c-4391-9271-450013860308 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:03.238609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923329ef-f552-457e-9934-803e8442360d None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:03.254946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382fce4-3e1a-46e4-9141-8a7b9a1b4bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:03.255608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382fce4-3e1a-46e4-9141-8a7b9a1b4bbc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:03.255896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382fce4-3e1a-46e4-9141-8a7b9a1b4bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:03.256176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382fce4-3e1a-46e4-9141-8a7b9a1b4bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:03.257006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382fce4-3e1a-46e4-9141-8a7b9a1b4bbc None admin] RBAC: Adding query filter params (group.id=a52495995e0044e38aede3875f88bef4, role.id=2fcd0ee644864d67833017de80ba1627, scope.project.id=6936fde9a1084ca0af66359685e524bb) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:03.257314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382fce4-3e1a-46e4-9141-8a7b9a1b4bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.258771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382fce4-3e1a-46e4-9141-8a7b9a1b4bbc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.264440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 220/448] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:23:03 2022] GET /identity/v3/role_assignments?group.id=a52495995e0044e38aede3875f88bef4&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=2fcd0ee644864d67833017de80ba1627 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:03.265364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382fce4-3e1a-46e4-9141-8a7b9a1b4bbc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:03.286553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd6852-0771-410a-815e-c4abf57cc1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:03.287256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd6852-0771-410a-815e-c4abf57cc1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:03.287539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd6852-0771-410a-815e-c4abf57cc1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:03.287813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd6852-0771-410a-815e-c4abf57cc1e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:03.336534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:03.368420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd6852-0771-410a-815e-c4abf57cc1e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.370256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd6852-0771-410a-815e-c4abf57cc1e7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.380968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382fce4-3e1a-46e4-9141-8a7b9a1b4bbc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:03.420964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c365a-0d4b-45f6-ba54-f39371404f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:03.421652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c365a-0d4b-45f6-ba54-f39371404f86 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:03.421928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c365a-0d4b-45f6-ba54-f39371404f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:03.422725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c365a-0d4b-45f6-ba54-f39371404f86 None admin] PATH_INFO: `/v3/projects/6936fde9a1084ca0af66359685e524bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:03.423338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c365a-0d4b-45f6-ba54-f39371404f86 None admin] RBAC: Authorizing `identity:get_project(project_id=6936fde9a1084ca0af66359685e524bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.424755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c365a-0d4b-45f6-ba54-f39371404f86 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.427778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 221/449] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:23:03 2022] GET /identity/v3/projects/6936fde9a1084ca0af66359685e524bb => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:03.432546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c365a-0d4b-45f6-ba54-f39371404f86 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:03.448082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:03.483856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 229/450] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:03.489975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd6852-0771-410a-815e-c4abf57cc1e7 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:03.555390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c365a-0d4b-45f6-ba54-f39371404f86 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:03.581379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:03.599419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1324b37-1057-4734-9067-e810608e5d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:03.600090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1324b37-1057-4734-9067-e810608e5d62 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:03.600954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1324b37-1057-4734-9067-e810608e5d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:03.601239 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1324b37-1057-4734-9067-e810608e5d62 None admin] PATH_INFO: `/v3/groups/a52495995e0044e38aede3875f88bef4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:03.602462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1324b37-1057-4734-9067-e810608e5d62 None admin] RBAC: Authorizing `identity:get_group(group_id=a52495995e0044e38aede3875f88bef4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.603903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1324b37-1057-4734-9067-e810608e5d62 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.609414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 222/451] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:23:03 2022] GET /identity/v3/groups/a52495995e0044e38aede3875f88bef4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:03.611333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1324b37-1057-4734-9067-e810608e5d62 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:03.618561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd6852-0771-410a-815e-c4abf57cc1e7 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:03.656661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56360eb3-8443-4fa1-9be9-5931498dc0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:03.657295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56360eb3-8443-4fa1-9be9-5931498dc0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:03.657632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56360eb3-8443-4fa1-9be9-5931498dc0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:03.657908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56360eb3-8443-4fa1-9be9-5931498dc0b9 None admin] PATH_INFO: `/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:03.659042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56360eb3-8443-4fa1-9be9-5931498dc0b9 None admin] RBAC: Authorizing `identity:get_project(project_id=bfeabf1f8bfc459e9c6e85a4b8e64db7)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.660460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56360eb3-8443-4fa1-9be9-5931498dc0b9 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.662142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 230/452] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:23:03 2022] GET /identity/v3/projects/bfeabf1f8bfc459e9c6e85a4b8e64db7 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:03.668058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56360eb3-8443-4fa1-9be9-5931498dc0b9 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:03.690885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:03.716220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1324b37-1057-4734-9067-e810608e5d62 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:03.749218 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63636-9ee2-4f05-a56e-88e21a37c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:03.749873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63636-9ee2-4f05-a56e-88e21a37c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:03.750139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63636-9ee2-4f05-a56e-88e21a37c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:03.750422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63636-9ee2-4f05-a56e-88e21a37c8f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:03.751200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d63636-9ee2-4f05-a56e-88e21a37c8f8 None admin] RBAC: Adding query filter params (group.id=a52495995e0044e38aede3875f88bef4, role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=6936fde9a1084ca0af66359685e524bb) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:03.751509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d63636-9ee2-4f05-a56e-88e21a37c8f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.752932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d63636-9ee2-4f05-a56e-88e21a37c8f8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.758647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 223/453] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:23:03 2022] GET /identity/v3/role_assignments?group.id=a52495995e0044e38aede3875f88bef4&scope.project.id=6936fde9a1084ca0af66359685e524bb&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:03.764535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56360eb3-8443-4fa1-9be9-5931498dc0b9 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:03.801645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdec00a-053c-4984-8291-efeb0a2883be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:03.802303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdec00a-053c-4984-8291-efeb0a2883be None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:03.802582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdec00a-053c-4984-8291-efeb0a2883be None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:03.802855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdec00a-053c-4984-8291-efeb0a2883be None admin] PATH_INFO: `/v3/groups/7ccdcf287a2746328e93b27fe5a98611` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:03.804126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdec00a-053c-4984-8291-efeb0a2883be None admin] RBAC: Authorizing `identity:get_group(group_id=7ccdcf287a2746328e93b27fe5a98611)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.805617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdec00a-053c-4984-8291-efeb0a2883be None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.807329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 231/454] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Aug 4 02:23:03 2022] GET /identity/v3/groups/7ccdcf287a2746328e93b27fe5a98611 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:03.813503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63636-9ee2-4f05-a56e-88e21a37c8f8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:03.918205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63636-9ee2-4f05-a56e-88e21a37c8f8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:03.951734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa9c50-cf8e-4878-9e65-ef69f78d350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:03.952348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa9c50-cf8e-4878-9e65-ef69f78d350d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:03.952622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa9c50-cf8e-4878-9e65-ef69f78d350d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:03.952891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa9c50-cf8e-4878-9e65-ef69f78d350d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:03.953728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa9c50-cf8e-4878-9e65-ef69f78d350d None admin] RBAC: Adding query filter params (group.id=7ccdcf287a2746328e93b27fe5a98611, role.id=999cac3070e64b82b981258349005963, scope.project.id=bfeabf1f8bfc459e9c6e85a4b8e64db7) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:03.954034 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa9c50-cf8e-4878-9e65-ef69f78d350d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:03.955457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa9c50-cf8e-4878-9e65-ef69f78d350d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:03.961959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 224/455] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Aug 4 02:23:03 2022] GET /identity/v3/role_assignments?group.id=7ccdcf287a2746328e93b27fe5a98611&scope.project.id=bfeabf1f8bfc459e9c6e85a4b8e64db7&role.id=999cac3070e64b82b981258349005963 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:06.299465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5206-6f6b-4b0b-b4db-6565f1a5bddf None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:06.299973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5206-6f6b-4b0b-b4db-6565f1a5bddf None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:06.300076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5206-6f6b-4b0b-b4db-6565f1a5bddf None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:06.301675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 232/456] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:06.307053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523009d3-ed56-48b9-8867-2b97dc15da49 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:06.307458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523009d3-ed56-48b9-8867-2b97dc15da49 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:06.307626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523009d3-ed56-48b9-8867-2b97dc15da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:06.314209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:06.335041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-523009d3-ed56-48b9-8867-2b97dc15da49 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:06.336737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-523009d3-ed56-48b9-8867-2b97dc15da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:06.433287 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 225/457] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:06.466140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5206-6f6b-4b0b-b4db-6565f1a5bddf None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:06.477625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:06.572772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140d80-2511-48ba-ad9c-036e752aecb0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:06.572958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140d80-2511-48ba-ad9c-036e752aecb0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:06.573232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140d80-2511-48ba-ad9c-036e752aecb0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:06.574673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 226/458] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:06.579806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0d76-0a31-4b8a-af3a-f3cf8faac16d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:06.580284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0d76-0a31-4b8a-af3a-f3cf8faac16d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:06.580700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0d76-0a31-4b8a-af3a-f3cf8faac16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:06.609600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ef0e0d76-0a31-4b8a-af3a-f3cf8faac16d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:06.610805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ef0e0d76-0a31-4b8a-af3a-f3cf8faac16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:06.627587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5206-6f6b-4b0b-b4db-6565f1a5bddf None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:06.698640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611caf02-91c0-4b09-81fd-b985d8360bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:06.699296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611caf02-91c0-4b09-81fd-b985d8360bff None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:06.699578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611caf02-91c0-4b09-81fd-b985d8360bff None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:06.699852 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611caf02-91c0-4b09-81fd-b985d8360bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:06.716527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611caf02-91c0-4b09-81fd-b985d8360bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:06.718396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611caf02-91c0-4b09-81fd-b985d8360bff None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-611caf02-91c0-4b09-81fd-b985d8360bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:06.745255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:06.746373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:06.747432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:06.747432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:06.747432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:06.747432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:06.749633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 233/459] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:06.757493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611caf02-91c0-4b09-81fd-b985d8360bff None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:06.760791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 227/460] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:06.817882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e0d76-0a31-4b8a-af3a-f3cf8faac16d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:06.857757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:06.904988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:06.913879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611caf02-91c0-4b09-81fd-b985d8360bff None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:06.952438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd5618-ea0d-4331-84e6-90707476824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:06.953055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd5618-ea0d-4331-84e6-90707476824e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:06.953246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e0d76-0a31-4b8a-af3a-f3cf8faac16d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:06.953437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd5618-ea0d-4331-84e6-90707476824e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:06.953630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd5618-ea0d-4331-84e6-90707476824e None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:06.954318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd5618-ea0d-4331-84e6-90707476824e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:06.954662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd5618-ea0d-4331-84e6-90707476824e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:06.956293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd5618-ea0d-4331-84e6-90707476824e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:06.972650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 234/461] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:06.972650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04347f-6340-4b7f-85a2-ea3fdb5d0fb1 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:06.972650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04347f-6340-4b7f-85a2-ea3fdb5d0fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:06.972650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04347f-6340-4b7f-85a2-ea3fdb5d0fb1 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:06.972650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 235/462] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:06.972650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f826ef-436a-4fc1-a286-e1d976289b23 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:06.973111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f826ef-436a-4fc1-a286-e1d976289b23 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:06.973111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f826ef-436a-4fc1-a286-e1d976289b23 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:06.974312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 236/463] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:06.974862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f826ef-436a-4fc1-a286-e1d976289b23 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:07.003030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f45f0f-03a1-4388-b251-d6d0a6f5d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:07.003665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f45f0f-03a1-4388-b251-d6d0a6f5d3ab None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.003946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f45f0f-03a1-4388-b251-d6d0a6f5d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.004218 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f45f0f-03a1-4388-b251-d6d0a6f5d3ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.014746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f45f0f-03a1-4388-b251-d6d0a6f5d3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:07.016199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f45f0f-03a1-4388-b251-d6d0a6f5d3ab None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-56f45f0f-03a1-4388-b251-d6d0a6f5d3ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:07.032272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:07.033155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:07.039500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:07.039500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:07.039500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:07.039500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:07.039500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 228/464] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:07.039500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd06d9-5e1d-45f1-b911-2e406fcb4c43 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.039500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd06d9-5e1d-45f1-b911-2e406fcb4c43 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.039500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd06d9-5e1d-45f1-b911-2e406fcb4c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.054384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-97bd06d9-5e1d-45f1-b911-2e406fcb4c43 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:07.056041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-97bd06d9-5e1d-45f1-b911-2e406fcb4c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:07.090870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f826ef-436a-4fc1-a286-e1d976289b23 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:07.116813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:07.128023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 229/465] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:07.129669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7ebe-2ef4-40cb-9182-24fd4e51bbcd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.129960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7ebe-2ef4-40cb-9182-24fd4e51bbcd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.130265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7ebe-2ef4-40cb-9182-24fd4e51bbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.141359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5620a-b8a6-4af0-9169-f2e9ed0cd6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:07.142831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5620a-b8a6-4af0-9169-f2e9ed0cd6ba None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.143338 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5620a-b8a6-4af0-9169-f2e9ed0cd6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.143804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5620a-b8a6-4af0-9169-f2e9ed0cd6ba None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.144945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5620a-b8a6-4af0-9169-f2e9ed0cd6ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:07.146644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5620a-b8a6-4af0-9169-f2e9ed0cd6ba None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:07.147919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-525c7ebe-2ef4-40cb-9182-24fd4e51bbcd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:07.149389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-525c7ebe-2ef4-40cb-9182-24fd4e51bbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:07.173481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 237/466] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:23:06 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:07.174386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5620a-b8a6-4af0-9169-f2e9ed0cd6ba None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:07.204537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:07.237526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 230/467] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:07.238833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c7ebe-2ef4-40cb-9182-24fd4e51bbcd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:07.328205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5620a-b8a6-4af0-9169-f2e9ed0cd6ba None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:07.365267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c7ebe-2ef4-40cb-9182-24fd4e51bbcd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:07.369251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92e8bb-7fc2-425d-bf4e-edf05e8dadd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:07.369947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92e8bb-7fc2-425d-bf4e-edf05e8dadd1 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.370229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92e8bb-7fc2-425d-bf4e-edf05e8dadd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.370505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92e8bb-7fc2-425d-bf4e-edf05e8dadd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.371196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92e8bb-7fc2-425d-bf4e-edf05e8dadd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:07.371497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92e8bb-7fc2-425d-bf4e-edf05e8dadd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:07.372863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92e8bb-7fc2-425d-bf4e-edf05e8dadd1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:07.387478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 238/468] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:07.388435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92e8bb-7fc2-425d-bf4e-edf05e8dadd1 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:07.405180 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e546-96c4-4b85-aafb-5e6a39d107e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:07.405901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e546-96c4-4b85-aafb-5e6a39d107e0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.406545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e546-96c4-4b85-aafb-5e6a39d107e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.406819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e546-96c4-4b85-aafb-5e6a39d107e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.420963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007e546-96c4-4b85-aafb-5e6a39d107e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:07.422444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007e546-96c4-4b85-aafb-5e6a39d107e0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a007e546-96c4-4b85-aafb-5e6a39d107e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:07.438667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:07.439744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:07.440808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:07.440808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:07.440808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:07.440808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:07.440808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 231/469] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:07.440808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e546-96c4-4b85-aafb-5e6a39d107e0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:07.442149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:07.481171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:07.525229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92e8bb-7fc2-425d-bf4e-edf05e8dadd1 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:07.562084 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e546-96c4-4b85-aafb-5e6a39d107e0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:07.573763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08b9b-fbaf-4b8e-b69f-305b46daa75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:07.575239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08b9b-fbaf-4b8e-b69f-305b46daa75c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.575729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08b9b-fbaf-4b8e-b69f-305b46daa75c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.576626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08b9b-fbaf-4b8e-b69f-305b46daa75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.592985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb08b9b-fbaf-4b8e-b69f-305b46daa75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:07.594915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb08b9b-fbaf-4b8e-b69f-305b46daa75c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:07.604901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215af2-ba85-4c20-9df4-72b2646195ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:07.606074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215af2-ba85-4c20-9df4-72b2646195ba None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.606584 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215af2-ba85-4c20-9df4-72b2646195ba None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.607060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215af2-ba85-4c20-9df4-72b2646195ba None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.608054 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215af2-ba85-4c20-9df4-72b2646195ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:07.609731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215af2-ba85-4c20-9df4-72b2646195ba None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-2cb08b9b-fbaf-4b8e-b69f-305b46daa75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:07.611044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:07.611867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:07.612729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:07.612729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:07.612729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:07.612729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:07.612729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 239/470] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:07.613471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08b9b-fbaf-4b8e-b69f-305b46daa75c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:07.649433 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 232/471] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:23:07 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:07.649433 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215af2-ba85-4c20-9df4-72b2646195ba None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:07.789708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:07.800543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:07.818510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08b9b-fbaf-4b8e-b69f-305b46daa75c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:07.826891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215af2-ba85-4c20-9df4-72b2646195ba None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:07.880988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd1970-ee7b-4391-b08e-0b70c282fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:07.881664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd1970-ee7b-4391-b08e-0b70c282fa13 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.881945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd1970-ee7b-4391-b08e-0b70c282fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.882218 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd1970-ee7b-4391-b08e-0b70c282fa13 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.882906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd1970-ee7b-4391-b08e-0b70c282fa13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:07.883206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd1970-ee7b-4391-b08e-0b70c282fa13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:07.883828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1051-c6a7-4e06-b4f3-0f7fc19f9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:07.884466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1051-c6a7-4e06-b4f3-0f7fc19f9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:07.884564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd1970-ee7b-4391-b08e-0b70c282fa13 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:07.884750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1051-c6a7-4e06-b4f3-0f7fc19f9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:07.885029 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1051-c6a7-4e06-b4f3-0f7fc19f9ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:07.885764 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa1051-c6a7-4e06-b4f3-0f7fc19f9ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:07.886069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa1051-c6a7-4e06-b4f3-0f7fc19f9ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:07.888163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa1051-c6a7-4e06-b4f3-0f7fc19f9ba0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:07.899614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 233/472] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:07.906308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd1970-ee7b-4391-b08e-0b70c282fa13 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:07.907712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 240/473] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:07.915893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1051-c6a7-4e06-b4f3-0f7fc19f9ba0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:08.025858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1051-c6a7-4e06-b4f3-0f7fc19f9ba0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:08.032197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd1970-ee7b-4391-b08e-0b70c282fa13 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:08.067871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205877df-5c21-44b7-8e85-83a709e4feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:08.068435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752278c-8355-41a4-b5ee-b3e89c69f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:08.068570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205877df-5c21-44b7-8e85-83a709e4feb0 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:08.068766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205877df-5c21-44b7-8e85-83a709e4feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:08.069042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752278c-8355-41a4-b5ee-b3e89c69f0c3 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:08.069192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205877df-5c21-44b7-8e85-83a709e4feb0 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:08.069383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752278c-8355-41a4-b5ee-b3e89c69f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:08.069656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752278c-8355-41a4-b5ee-b3e89c69f0c3 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:08.069816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205877df-5c21-44b7-8e85-83a709e4feb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:08.070321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752278c-8355-41a4-b5ee-b3e89c69f0c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:08.071216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205877df-5c21-44b7-8e85-83a709e4feb0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:08.071843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752278c-8355-41a4-b5ee-b3e89c69f0c3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:08.090462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:08.102102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 241/474] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:23:07 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:23:08.102531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 234/475] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:23:07 2022] POST /identity/v3/users => generated 249 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:08.107214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8f49c-448a-4193-a818-19161a6b7469 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:08.107214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8f49c-448a-4193-a818-19161a6b7469 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:08.107214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8f49c-448a-4193-a818-19161a6b7469 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:08.107214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 235/476] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:08.112123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc552f1e-f309-4ab4-91e8-759381f1e056 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:08.112486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc552f1e-f309-4ab4-91e8-759381f1e056 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:08.112833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc552f1e-f309-4ab4-91e8-759381f1e056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:08.133976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-dc552f1e-f309-4ab4-91e8-759381f1e056 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:08.135465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dc552f1e-f309-4ab4-91e8-759381f1e056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:08.215527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 236/477] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:08.238392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205877df-5c21-44b7-8e85-83a709e4feb0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:08.243184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:08.359313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205877df-5c21-44b7-8e85-83a709e4feb0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:08.394756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:08.395375 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:08.395654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:08.395931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:08.396641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:08.398122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:08.409041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.sql.core [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 02:23:08.409041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 02:23:08.409041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [parameters: {'id': '69e9164bca5e4876afd71fffb8ceab5c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 02:23:08.409041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80480) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application result.read() Aug 04 02:23:08.426854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:23:08.427761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application yield resource Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise self.value Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application session.commit() Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 02:23:08.429476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.session.flush() Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application compat.raise_( Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 02:23:08.431333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:23:08.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application result.read() Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:23:08.435415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [parameters: {'id': '69e9164bca5e4876afd71fffb8ceab5c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:08.437389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 02:23:08.439357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:08.442388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 242/478] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Aug 4 02:23:08 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:08.442540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc552f1e-f309-4ab4-91e8-759381f1e056 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:08.547786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc552f1e-f309-4ab4-91e8-759381f1e056 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:08.578812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:08.590750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84187186-ae5d-4461-bb50-52475c014191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:08.591407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84187186-ae5d-4461-bb50-52475c014191 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:08.591689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84187186-ae5d-4461-bb50-52475c014191 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:08.591963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84187186-ae5d-4461-bb50-52475c014191 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:08.608940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84187186-ae5d-4461-bb50-52475c014191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-84187186-ae5d-4461-bb50-52475c014191 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:08.614005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:08.614873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:08.615658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 237/479] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:08.622559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:08.712036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:08.752154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126399d-c103-45ad-8b23-5eea804bc763 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:08.792768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3159ed5-0ab4-482f-bcda-42e781970af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:08.793426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3159ed5-0ab4-482f-bcda-42e781970af6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:08.793713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3159ed5-0ab4-482f-bcda-42e781970af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:08.793989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3159ed5-0ab4-482f-bcda-42e781970af6 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:08.794774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3159ed5-0ab4-482f-bcda-42e781970af6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:08.795081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3159ed5-0ab4-482f-bcda-42e781970af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:08.796454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3159ed5-0ab4-482f-bcda-42e781970af6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:08.811306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 243/480] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:09.674697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2076e62-5bc8-49e6-9942-086c8fdf8b5c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:09.675739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2076e62-5bc8-49e6-9942-086c8fdf8b5c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:09.676231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2076e62-5bc8-49e6-9942-086c8fdf8b5c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:09.678297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 238/481] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:09.685129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146b4a1-9783-408b-9472-2f5a39628953 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:09.686107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146b4a1-9783-408b-9472-2f5a39628953 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:09.686597 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146b4a1-9783-408b-9472-2f5a39628953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:09.713761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8146b4a1-9783-408b-9472-2f5a39628953 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:09.715308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8146b4a1-9783-408b-9472-2f5a39628953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:09.797453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 244/482] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:09.815054 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2076e62-5bc8-49e6-9942-086c8fdf8b5c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:09.953989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2076e62-5bc8-49e6-9942-086c8fdf8b5c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:09.991976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8efc2b-04a8-4b3c-b7f3-cd836713046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:09.992615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8efc2b-04a8-4b3c-b7f3-cd836713046a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:09.992898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8efc2b-04a8-4b3c-b7f3-cd836713046a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:09.993173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8efc2b-04a8-4b3c-b7f3-cd836713046a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.009017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8efc2b-04a8-4b3c-b7f3-cd836713046a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-aa8efc2b-04a8-4b3c-b7f3-cd836713046a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:10.014435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:10.015364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:10.016533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 239/483] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:10.026424 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146b4a1-9783-408b-9472-2f5a39628953 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:10.117011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:10.171666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146b4a1-9783-408b-9472-2f5a39628953 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:10.188216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429d90-4ffb-4f28-ac58-7459e1932a7b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.188522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429d90-4ffb-4f28-ac58-7459e1932a7b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.188772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429d90-4ffb-4f28-ac58-7459e1932a7b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.190400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 240/484] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:10.197101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7f5a8-7bff-4e4f-990a-dd43c3ed452b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.197416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7f5a8-7bff-4e4f-990a-dd43c3ed452b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.197688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7f5a8-7bff-4e4f-990a-dd43c3ed452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.227972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544c501-1cad-4000-99fb-d9282551f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:10.228955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544c501-1cad-4000-99fb-d9282551f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.229457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544c501-1cad-4000-99fb-d9282551f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.230083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544c501-1cad-4000-99fb-d9282551f5d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.230998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544c501-1cad-4000-99fb-d9282551f5d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:10.231496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544c501-1cad-4000-99fb-d9282551f5d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:10.233189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544c501-1cad-4000-99fb-d9282551f5d5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:10.238399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3ab7f5a8-7bff-4e4f-990a-dd43c3ed452b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:10.239849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3ab7f5a8-7bff-4e4f-990a-dd43c3ed452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:10.249479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 245/485] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:10.251009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544c501-1cad-4000-99fb-d9282551f5d5 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:10.337838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:10.373250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544c501-1cad-4000-99fb-d9282551f5d5 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:10.386669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 241/486] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:10.403564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:10.416076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc60d5-5ebb-4d0b-9fe8-744e4712425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:10.416993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc60d5-5ebb-4d0b-9fe8-744e4712425f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.417596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc60d5-5ebb-4d0b-9fe8-744e4712425f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.418149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc60d5-5ebb-4d0b-9fe8-744e4712425f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.421594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7f5a8-7bff-4e4f-990a-dd43c3ed452b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:10.446626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc60d5-5ebb-4d0b-9fe8-744e4712425f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:10.449463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc60d5-5ebb-4d0b-9fe8-744e4712425f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-08bc60d5-5ebb-4d0b-9fe8-744e4712425f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:10.474614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:10.475537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:10.481261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:10.481261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:10.481261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:10.481261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:10.481261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 246/487] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:10.484954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc60d5-5ebb-4d0b-9fe8-744e4712425f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:10.567511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7f5a8-7bff-4e4f-990a-dd43c3ed452b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:10.655631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc60d5-5ebb-4d0b-9fe8-744e4712425f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:10.660009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff17113-cbb5-444f-b2d7-714467e9cef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:10.660661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff17113-cbb5-444f-b2d7-714467e9cef4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.660940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff17113-cbb5-444f-b2d7-714467e9cef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.661208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff17113-cbb5-444f-b2d7-714467e9cef4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.693434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff17113-cbb5-444f-b2d7-714467e9cef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:10.694235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c2d85-8d93-412a-b4f5-70fca395771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:10.694835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c2d85-8d93-412a-b4f5-70fca395771d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.695116 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c2d85-8d93-412a-b4f5-70fca395771d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.695388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c2d85-8d93-412a-b4f5-70fca395771d None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.696092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c2d85-8d93-412a-b4f5-70fca395771d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:10.696395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c2d85-8d93-412a-b4f5-70fca395771d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:10.697950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c2d85-8d93-412a-b4f5-70fca395771d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-fff17113-cbb5-444f-b2d7-714467e9cef4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:10.701104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:10.702035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:10.702817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:10.705472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 242/488] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:10.707507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdfbb0-0d8c-428b-b3fe-2fa634058cf1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.708011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdfbb0-0d8c-428b-b3fe-2fa634058cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.708484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdfbb0-0d8c-428b-b3fe-2fa634058cf1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.714121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 243/489] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:10.715396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdfbb0-0d8c-428b-b3fe-2fa634058cf1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:10.716729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 247/490] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:10.718126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecaeed-baeb-44ac-8906-4c508a23a5cb None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.718466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecaeed-baeb-44ac-8906-4c508a23a5cb None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.718744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecaeed-baeb-44ac-8906-4c508a23a5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.738419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-c2ecaeed-baeb-44ac-8906-4c508a23a5cb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:10.739735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c2ecaeed-baeb-44ac-8906-4c508a23a5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:10.763746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:10.770648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:10.816922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 248/491] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:10.817917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecaeed-baeb-44ac-8906-4c508a23a5cb None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:10.827626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdfbb0-0d8c-428b-b3fe-2fa634058cf1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:10.863845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4150a7-b20f-43b1-902e-c71aa0124d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:10.864454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4150a7-b20f-43b1-902e-c71aa0124d2b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.864788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4150a7-b20f-43b1-902e-c71aa0124d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.865068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4150a7-b20f-43b1-902e-c71aa0124d2b None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.865808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4150a7-b20f-43b1-902e-c71aa0124d2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:10.866136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4150a7-b20f-43b1-902e-c71aa0124d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:10.867528 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4150a7-b20f-43b1-902e-c71aa0124d2b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:10.880497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 244/492] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:10.880497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185f2a-f8bb-42bb-9cad-148d25369387 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.880497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185f2a-f8bb-42bb-9cad-148d25369387 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.880497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185f2a-f8bb-42bb-9cad-148d25369387 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.880811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 245/493] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:10.883188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4185f2a-f8bb-42bb-9cad-148d25369387 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:10.926661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecaeed-baeb-44ac-8906-4c508a23a5cb None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:10.960924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692846ec-0746-4f81-aa71-82044f15ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:10.961587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692846ec-0746-4f81-aa71-82044f15ca08 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:10.961872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692846ec-0746-4f81-aa71-82044f15ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:10.962143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692846ec-0746-4f81-aa71-82044f15ca08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:10.969421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692846ec-0746-4f81-aa71-82044f15ca08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:10.970866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692846ec-0746-4f81-aa71-82044f15ca08 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-692846ec-0746-4f81-aa71-82044f15ca08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:10.984475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:10.985433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 249/494] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Aug 4 02:23:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:10.986407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692846ec-0746-4f81-aa71-82044f15ca08 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:10.988241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:10.994756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4185f2a-f8bb-42bb-9cad-148d25369387 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.015280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:11.031396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f6db6-ff42-4704-96a3-832b2ebce7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.032041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6db6-ff42-4704-96a3-832b2ebce7ce None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.032333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6db6-ff42-4704-96a3-832b2ebce7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.032597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6db6-ff42-4704-96a3-832b2ebce7ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.042879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f6db6-ff42-4704-96a3-832b2ebce7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-416f6db6-ff42-4704-96a3-832b2ebce7ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:11.049050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:11.050183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:11.051177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 246/495] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:11.051920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfad24d-13c4-4dcc-a322-69aa39f71dc6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.052144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfad24d-13c4-4dcc-a322-69aa39f71dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.052415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfad24d-13c4-4dcc-a322-69aa39f71dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.071259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6bfad24d-13c4-4dcc-a322-69aa39f71dc6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:11.072449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6bfad24d-13c4-4dcc-a322-69aa39f71dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:11.102462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692846ec-0746-4f81-aa71-82044f15ca08 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.138795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f15b-376a-44d7-8672-e6232ce04a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.139784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f15b-376a-44d7-8672-e6232ce04a0e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.140162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f15b-376a-44d7-8672-e6232ce04a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.145528 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 247/496] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:11.145672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f15b-376a-44d7-8672-e6232ce04a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.145760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfad24d-13c4-4dcc-a322-69aa39f71dc6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.153268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f15b-376a-44d7-8672-e6232ce04a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:11.155402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f15b-376a-44d7-8672-e6232ce04a0e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-0287f15b-376a-44d7-8672-e6232ce04a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:11.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:11.172755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:11.173851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:11.173851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:11.173851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:11.173851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:11.177423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 250/497] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:11.177423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f15b-376a-44d7-8672-e6232ce04a0e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.244260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:11.255755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfad24d-13c4-4dcc-a322-69aa39f71dc6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.261570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:11.287045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f15b-376a-44d7-8672-e6232ce04a0e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.291837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b415-8991-4231-8883-97b874139e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.292451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b415-8991-4231-8883-97b874139e91 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.292731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b415-8991-4231-8883-97b874139e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.293001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3b415-8991-4231-8883-97b874139e91 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.293820 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3b415-8991-4231-8883-97b874139e91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:11.294132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3b415-8991-4231-8883-97b874139e91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:11.295552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3b415-8991-4231-8883-97b874139e91 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:11.322583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c74c1-a89c-4102-99eb-a70b1ecabb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.323188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c74c1-a89c-4102-99eb-a70b1ecabb1d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.323468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c74c1-a89c-4102-99eb-a70b1ecabb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.323740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c74c1-a89c-4102-99eb-a70b1ecabb1d None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.324438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c74c1-a89c-4102-99eb-a70b1ecabb1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:11.324736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c74c1-a89c-4102-99eb-a70b1ecabb1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:11.326112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c74c1-a89c-4102-99eb-a70b1ecabb1d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:11.332342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 248/498] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:11.340913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b415-8991-4231-8883-97b874139e91 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.341014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 251/499] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:11.341014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c74c1-a89c-4102-99eb-a70b1ecabb1d None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.440805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3b415-8991-4231-8883-97b874139e91 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.444337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c74c1-a89c-4102-99eb-a70b1ecabb1d None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.474422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8ea0e-d940-4a6a-82f4-eb46b3674c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.475071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8ea0e-d940-4a6a-82f4-eb46b3674c64 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.475910 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8ea0e-d940-4a6a-82f4-eb46b3674c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.476235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8ea0e-d940-4a6a-82f4-eb46b3674c64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.480259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae517d-788b-4fbc-b7ed-8bf37d8acdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.480921 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae517d-788b-4fbc-b7ed-8bf37d8acdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.481203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae517d-788b-4fbc-b7ed-8bf37d8acdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.481445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae517d-788b-4fbc-b7ed-8bf37d8acdf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.482229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae517d-788b-4fbc-b7ed-8bf37d8acdf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:11.482530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae517d-788b-4fbc-b7ed-8bf37d8acdf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:11.483890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae517d-788b-4fbc-b7ed-8bf37d8acdf0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:11.487020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8ea0e-d940-4a6a-82f4-eb46b3674c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:11.492133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-36f8ea0e-d940-4a6a-82f4-eb46b3674c64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:11.492574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:11.493710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:11.494705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:11.498943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 249/500] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:11.499671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8ea0e-d940-4a6a-82f4-eb46b3674c64 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.505200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 252/501] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:11.505200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae517d-788b-4fbc-b7ed-8bf37d8acdf0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.511755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:11.606949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8ea0e-d940-4a6a-82f4-eb46b3674c64 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.617125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae517d-788b-4fbc-b7ed-8bf37d8acdf0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.640294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb1ee6-8cdf-4b5a-a89a-6378a289a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.640894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb1ee6-8cdf-4b5a-a89a-6378a289a199 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.641174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb1ee6-8cdf-4b5a-a89a-6378a289a199 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.641482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb1ee6-8cdf-4b5a-a89a-6378a289a199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.649791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c72a8-97ba-4997-9478-b8b80ef027f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.650423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c72a8-97ba-4997-9478-b8b80ef027f8 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.650700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c72a8-97ba-4997-9478-b8b80ef027f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.650973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c72a8-97ba-4997-9478-b8b80ef027f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.660965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c72a8-97ba-4997-9478-b8b80ef027f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:11.662441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c72a8-97ba-4997-9478-b8b80ef027f8 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-aa5c72a8-97ba-4997-9478-b8b80ef027f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:11.677612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:11.679044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:11.679965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:11.679965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:11.679965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:11.679965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:11.679965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 253/502] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:11.680228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c72a8-97ba-4997-9478-b8b80ef027f8 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.711929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb1ee6-8cdf-4b5a-a89a-6378a289a199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:11.713418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb1ee6-8cdf-4b5a-a89a-6378a289a199 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:11.722808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:11.731376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:11.781352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c72a8-97ba-4997-9478-b8b80ef027f8 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.812820 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 250/503] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:11.813671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb1ee6-8cdf-4b5a-a89a-6378a289a199 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.818763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a23d36-bd42-432e-a295-077890e4ece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.819406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a23d36-bd42-432e-a295-077890e4ece5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.819685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a23d36-bd42-432e-a295-077890e4ece5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.819958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a23d36-bd42-432e-a295-077890e4ece5 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.820673 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a23d36-bd42-432e-a295-077890e4ece5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:11.820979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a23d36-bd42-432e-a295-077890e4ece5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:11.822376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a23d36-bd42-432e-a295-077890e4ece5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:11.830439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 254/504] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:11.831584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4de07-ed5d-4bbe-8aaa-fcf5b68fad79 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.831866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4de07-ed5d-4bbe-8aaa-fcf5b68fad79 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.832136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4de07-ed5d-4bbe-8aaa-fcf5b68fad79 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.837363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 255/505] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:11.837363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4de07-ed5d-4bbe-8aaa-fcf5b68fad79 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.914449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb1ee6-8cdf-4b5a-a89a-6378a289a199 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.923363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:11.934504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4de07-ed5d-4bbe-8aaa-fcf5b68fad79 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:11.946961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:11.948894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5edd3-b3ec-49bb-a06f-0d02813c625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.949570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5edd3-b3ec-49bb-a06f-0d02813c625f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.949834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5edd3-b3ec-49bb-a06f-0d02813c625f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.950136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5edd3-b3ec-49bb-a06f-0d02813c625f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.957003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5edd3-b3ec-49bb-a06f-0d02813c625f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:11.958480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5edd3-b3ec-49bb-a06f-0d02813c625f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:11.969908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858df9a-feae-4b90-a6a0-4203ef6e1bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:11.970511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858df9a-feae-4b90-a6a0-4203ef6e1bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:11.970791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858df9a-feae-4b90-a6a0-4203ef6e1bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:11.971065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858df9a-feae-4b90-a6a0-4203ef6e1bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-31c5edd3-b3ec-49bb-a06f-0d02813c625f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:11.971680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:11.972673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:23:11.973642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:11.974153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858df9a-feae-4b90-a6a0-4203ef6e1bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:11.974153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858df9a-feae-4b90-a6a0-4203ef6e1bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:11.974275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 251/506] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:11.974275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5edd3-b3ec-49bb-a06f-0d02813c625f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:11.974398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858df9a-feae-4b90-a6a0-4203ef6e1bc7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:11.986558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 256/507] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:11.987403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858df9a-feae-4b90-a6a0-4203ef6e1bc7 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.072529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5edd3-b3ec-49bb-a06f-0d02813c625f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.083064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858df9a-feae-4b90-a6a0-4203ef6e1bc7 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.105335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e721e05-b04c-47a9-ae99-892eb5ee1c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.105975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e721e05-b04c-47a9-ae99-892eb5ee1c61 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.106252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e721e05-b04c-47a9-ae99-892eb5ee1c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.106529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e721e05-b04c-47a9-ae99-892eb5ee1c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.116263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2426c5d-93d6-4af5-8a74-c2d91c368a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.116660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e721e05-b04c-47a9-ae99-892eb5ee1c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.116875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2426c5d-93d6-4af5-8a74-c2d91c368a03 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.117149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2426c5d-93d6-4af5-8a74-c2d91c368a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.117447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2426c5d-93d6-4af5-8a74-c2d91c368a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.118139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e721e05-b04c-47a9-ae99-892eb5ee1c61 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.127044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2426c5d-93d6-4af5-8a74-c2d91c368a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.128443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2426c5d-93d6-4af5-8a74-c2d91c368a03 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-2e721e05-b04c-47a9-ae99-892eb5ee1c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:12.132293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:12.133270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:12.134337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:12.134337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:12.134337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:12.134337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:12.134337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 252/508] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:12.134658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c72c94-8baa-41a0-a59e-5d19ec833dfe None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.134950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c72c94-8baa-41a0-a59e-5d19ec833dfe None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.135230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c72c94-8baa-41a0-a59e-5d19ec833dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-f2426c5d-93d6-4af5-8a74-c2d91c368a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:12.148909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:12.149978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:12.151009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:12.151009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:12.151009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:12.151009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:12.151009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 257/509] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:12.151009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2426c5d-93d6-4af5-8a74-c2d91c368a03 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.155943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-37c72c94-8baa-41a0-a59e-5d19ec833dfe None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:12.157214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-37c72c94-8baa-41a0-a59e-5d19ec833dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:12.171206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:12.176528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:12.223328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 253/510] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:12.224228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c72c94-8baa-41a0-a59e-5d19ec833dfe None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.266459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2426c5d-93d6-4af5-8a74-c2d91c368a03 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.299153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d05ed-73e7-45aa-8dfc-85f15af02bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.299866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d05ed-73e7-45aa-8dfc-85f15af02bbe None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.300143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d05ed-73e7-45aa-8dfc-85f15af02bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.300413 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d05ed-73e7-45aa-8dfc-85f15af02bbe None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.301195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d05ed-73e7-45aa-8dfc-85f15af02bbe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:12.301522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d05ed-73e7-45aa-8dfc-85f15af02bbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.302946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d05ed-73e7-45aa-8dfc-85f15af02bbe None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.321727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c72c94-8baa-41a0-a59e-5d19ec833dfe None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.338838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 258/511] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:12.339579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d05ed-73e7-45aa-8dfc-85f15af02bbe None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.357452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d613a-a236-4887-ac4a-2d24b940bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.358086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d613a-a236-4887-ac4a-2d24b940bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.358368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d613a-a236-4887-ac4a-2d24b940bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.358638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d613a-a236-4887-ac4a-2d24b940bbbf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.365493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d613a-a236-4887-ac4a-2d24b940bbbf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.366932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d613a-a236-4887-ac4a-2d24b940bbbf None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d76d613a-a236-4887-ac4a-2d24b940bbbf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:12.378175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:12.379082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:12.379973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 254/512] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:12.380510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d613a-a236-4887-ac4a-2d24b940bbbf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.392723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:12.427663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:12.447918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d05ed-73e7-45aa-8dfc-85f15af02bbe None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.480557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d613a-a236-4887-ac4a-2d24b940bbbf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.480703 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f39dd-af0a-44ee-9744-e8cf857c1413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.481242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f39dd-af0a-44ee-9744-e8cf857c1413 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.481561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f39dd-af0a-44ee-9744-e8cf857c1413 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.481831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f39dd-af0a-44ee-9744-e8cf857c1413 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.482506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f39dd-af0a-44ee-9744-e8cf857c1413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:12.482806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f39dd-af0a-44ee-9744-e8cf857c1413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.484199 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f39dd-af0a-44ee-9744-e8cf857c1413 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.495624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 259/513] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:12.496398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f39dd-af0a-44ee-9744-e8cf857c1413 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.514043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029703eb-afe3-4efb-ab34-122386acf198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.514645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029703eb-afe3-4efb-ab34-122386acf198 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.514921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029703eb-afe3-4efb-ab34-122386acf198 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.515195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029703eb-afe3-4efb-ab34-122386acf198 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.515869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029703eb-afe3-4efb-ab34-122386acf198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:12.516157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029703eb-afe3-4efb-ab34-122386acf198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.517537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029703eb-afe3-4efb-ab34-122386acf198 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.529072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 255/514] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:12.530142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029703eb-afe3-4efb-ab34-122386acf198 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.599376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:12.602896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f39dd-af0a-44ee-9744-e8cf857c1413 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.631390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029703eb-afe3-4efb-ab34-122386acf198 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.635617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c41ad-c338-45d0-9238-865c1e634389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.636243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c41ad-c338-45d0-9238-865c1e634389 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.636519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c41ad-c338-45d0-9238-865c1e634389 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.636788 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c41ad-c338-45d0-9238-865c1e634389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.646991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c41ad-c338-45d0-9238-865c1e634389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.648947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c41ad-c338-45d0-9238-865c1e634389 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.650631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-e24c41ad-c338-45d0-9238-865c1e634389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:12.665273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:12.666304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:12.667339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:12.667339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:12.667339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:12.667339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:12.667339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 260/515] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:12.667339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c41ad-c338-45d0-9238-865c1e634389 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.668428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053909cb-2e6a-4e36-b2c9-911fe96b88ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.669040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053909cb-2e6a-4e36-b2c9-911fe96b88ef None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.669316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053909cb-2e6a-4e36-b2c9-911fe96b88ef None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.669613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053909cb-2e6a-4e36-b2c9-911fe96b88ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.740903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053909cb-2e6a-4e36-b2c9-911fe96b88ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.742383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053909cb-2e6a-4e36-b2c9-911fe96b88ef None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.765922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c41ad-c338-45d0-9238-865c1e634389 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.799599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5d03f-a254-4fd8-92a4-6c56681444fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.800208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d03f-a254-4fd8-92a4-6c56681444fd None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.800492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d03f-a254-4fd8-92a4-6c56681444fd None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.800777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d03f-a254-4fd8-92a4-6c56681444fd None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.801598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5d03f-a254-4fd8-92a4-6c56681444fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:12.801913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5d03f-a254-4fd8-92a4-6c56681444fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.803462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5d03f-a254-4fd8-92a4-6c56681444fd None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.808862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:12.821662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 261/516] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:12.822302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5d03f-a254-4fd8-92a4-6c56681444fd None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.845978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 256/517] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:12.845978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053909cb-2e6a-4e36-b2c9-911fe96b88ef None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.876463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:12.923923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5d03f-a254-4fd8-92a4-6c56681444fd None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.938644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053909cb-2e6a-4e36-b2c9-911fe96b88ef None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:12.957514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5060b4-515b-4008-b773-baa665455f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.958145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5060b4-515b-4008-b773-baa665455f34 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.958427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5060b4-515b-4008-b773-baa665455f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.958707 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5060b4-515b-4008-b773-baa665455f34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.965826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5060b4-515b-4008-b773-baa665455f34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.967283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5060b4-515b-4008-b773-baa665455f34 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.972027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0afb-a459-4e6e-ad5d-087ff35f1423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:12.972761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0afb-a459-4e6e-ad5d-087ff35f1423 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:12.972928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0afb-a459-4e6e-ad5d-087ff35f1423 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:12.973197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0afb-a459-4e6e-ad5d-087ff35f1423 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-7c5060b4-515b-4008-b773-baa665455f34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:12.979163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:12.980013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:12.980869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:12.980869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:12.980869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:12.980869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:12.980869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:12.980869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:12.980869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:12.980869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:12.981283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0afb-a459-4e6e-ad5d-087ff35f1423 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:12.981370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 262/518] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:12.981370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5060b4-515b-4008-b773-baa665455f34 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:12.981491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0afb-a459-4e6e-ad5d-087ff35f1423 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-148b0afb-a459-4e6e-ad5d-087ff35f1423 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:12.997041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:12.998009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:12.998890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 257/519] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:12.999500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0afb-a459-4e6e-ad5d-087ff35f1423 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.033204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:13.090228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5060b4-515b-4008-b773-baa665455f34 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.102903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:13.103324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0afb-a459-4e6e-ad5d-087ff35f1423 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.124091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c43b7-314b-4c34-937e-a8c3d376ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.124699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c43b7-314b-4c34-937e-a8c3d376ea6e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.124978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c43b7-314b-4c34-937e-a8c3d376ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.125257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c43b7-314b-4c34-937e-a8c3d376ea6e None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:13.125971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c43b7-314b-4c34-937e-a8c3d376ea6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:13.126286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c43b7-314b-4c34-937e-a8c3d376ea6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:13.127689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c43b7-314b-4c34-937e-a8c3d376ea6e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:13.136374 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba9d0-94d4-4b1e-8bfe-2ca2538b9510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.136981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba9d0-94d4-4b1e-8bfe-2ca2538b9510 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.137264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba9d0-94d4-4b1e-8bfe-2ca2538b9510 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.137569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba9d0-94d4-4b1e-8bfe-2ca2538b9510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:13.139162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 263/520] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:13.139952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c43b7-314b-4c34-937e-a8c3d376ea6e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.208718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ba9d0-94d4-4b1e-8bfe-2ca2538b9510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:13.210717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ba9d0-94d4-4b1e-8bfe-2ca2538b9510 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:13.238327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c43b7-314b-4c34-937e-a8c3d376ea6e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.239974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:13.272701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbbfa2-5d6a-4328-bb2d-2e3726938c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.273352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbbfa2-5d6a-4328-bb2d-2e3726938c5c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.273633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbbfa2-5d6a-4328-bb2d-2e3726938c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.273906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbbfa2-5d6a-4328-bb2d-2e3726938c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:13.283901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbbfa2-5d6a-4328-bb2d-2e3726938c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:13.285363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbbfa2-5d6a-4328-bb2d-2e3726938c5c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-0efbbfa2-5d6a-4328-bb2d-2e3726938c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:13.299840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:13.300831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:13.306872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:13.306872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:13.306872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:13.306872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:13.306872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 264/521] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:13.306872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbbfa2-5d6a-4328-bb2d-2e3726938c5c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.313319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 258/522] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:13.313319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba9d0-94d4-4b1e-8bfe-2ca2538b9510 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.330606 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:13.403608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbbfa2-5d6a-4328-bb2d-2e3726938c5c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.408094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba9d0-94d4-4b1e-8bfe-2ca2538b9510 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.436043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:13.437503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564b81-c214-4d6e-81e0-9723768a2c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.438111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564b81-c214-4d6e-81e0-9723768a2c34 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.438399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564b81-c214-4d6e-81e0-9723768a2c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.438778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564b81-c214-4d6e-81e0-9723768a2c34 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:13.439421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564b81-c214-4d6e-81e0-9723768a2c34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:13.439727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564b81-c214-4d6e-81e0-9723768a2c34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:13.441136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564b81-c214-4d6e-81e0-9723768a2c34 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:13.442673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36259e81-b7df-438a-8e87-16f7a01d37cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.443280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36259e81-b7df-438a-8e87-16f7a01d37cf None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.443562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36259e81-b7df-438a-8e87-16f7a01d37cf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.443862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36259e81-b7df-438a-8e87-16f7a01d37cf None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:13.445356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36259e81-b7df-438a-8e87-16f7a01d37cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:13.445666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36259e81-b7df-438a-8e87-16f7a01d37cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:13.447067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36259e81-b7df-438a-8e87-16f7a01d37cf None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:13.459299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 265/523] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:13.460141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564b81-c214-4d6e-81e0-9723768a2c34 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.464053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 259/524] 10.222.0.69 () {56 vars in 1139 bytes} [Thu Aug 4 02:23:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:13.464635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36259e81-b7df-438a-8e87-16f7a01d37cf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.549779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:13.566773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36259e81-b7df-438a-8e87-16f7a01d37cf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.566994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564b81-c214-4d6e-81e0-9723768a2c34 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.601598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43719fc4-b2f8-45a6-abed-5dbcb91addb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.601963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddade29a-afef-4301-a7f6-8a3b31c58c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.602194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43719fc4-b2f8-45a6-abed-5dbcb91addb8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.602467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43719fc4-b2f8-45a6-abed-5dbcb91addb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.602567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade29a-afef-4301-a7f6-8a3b31c58c8e None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.602735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43719fc4-b2f8-45a6-abed-5dbcb91addb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:13.602822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade29a-afef-4301-a7f6-8a3b31c58c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.603099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade29a-afef-4301-a7f6-8a3b31c58c8e None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:13.603410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43719fc4-b2f8-45a6-abed-5dbcb91addb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:13.603704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43719fc4-b2f8-45a6-abed-5dbcb91addb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:13.603791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddade29a-afef-4301-a7f6-8a3b31c58c8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:13.605057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43719fc4-b2f8-45a6-abed-5dbcb91addb8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:13.605180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddade29a-afef-4301-a7f6-8a3b31c58c8e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:13.616744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 260/525] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:13.617554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43719fc4-b2f8-45a6-abed-5dbcb91addb8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.626983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 266/526] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:23:13 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:13.627809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddade29a-afef-4301-a7f6-8a3b31c58c8e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.681607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:13.743258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43719fc4-b2f8-45a6-abed-5dbcb91addb8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.746549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddade29a-afef-4301-a7f6-8a3b31c58c8e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.783474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195305d5-48ed-4153-a64e-aea20db40e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.784118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195305d5-48ed-4153-a64e-aea20db40e1a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.784399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195305d5-48ed-4153-a64e-aea20db40e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.785369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195305d5-48ed-4153-a64e-aea20db40e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:13.787615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee333b4-803c-4794-a13d-993f9f23b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.788896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee333b4-803c-4794-a13d-993f9f23b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.788896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee333b4-803c-4794-a13d-993f9f23b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.788896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee333b4-803c-4794-a13d-993f9f23b4d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:13.789610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee333b4-803c-4794-a13d-993f9f23b4d7 None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=b0096da9bf564ceca61af67cac713f30) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:13.789912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee333b4-803c-4794-a13d-993f9f23b4d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:13.791345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee333b4-803c-4794-a13d-993f9f23b4d7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:13.797114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 267/527] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:13 2022] GET /identity/v3/role_assignments?user.id=b0096da9bf564ceca61af67cac713f30&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:13.798793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee333b4-803c-4794-a13d-993f9f23b4d7 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.801545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:13.805936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195305d5-48ed-4153-a64e-aea20db40e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:13.807462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195305d5-48ed-4153-a64e-aea20db40e1a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-195305d5-48ed-4153-a64e-aea20db40e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:13.826524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:13.827499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:13.828647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:13.828647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:13.828647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:13.828647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:13.828647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 261/528] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:13.829258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195305d5-48ed-4153-a64e-aea20db40e1a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:13.935006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee333b4-803c-4794-a13d-993f9f23b4d7 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.965742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195305d5-48ed-4153-a64e-aea20db40e1a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:13.968617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:13.981926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6fe9f-6d88-4b78-9edf-f7e70b374592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:13.982558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fe9f-6d88-4b78-9edf-f7e70b374592 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:13.982838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fe9f-6d88-4b78-9edf-f7e70b374592 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:13.983112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fe9f-6d88-4b78-9edf-f7e70b374592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:14.003582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbf803-b19c-4381-84de-016a73c45805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:14.004476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf803-b19c-4381-84de-016a73c45805 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:14.004834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf803-b19c-4381-84de-016a73c45805 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:14.005564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf803-b19c-4381-84de-016a73c45805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:14.015005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbf803-b19c-4381-84de-016a73c45805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:14.017412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbf803-b19c-4381-84de-016a73c45805 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-80bbf803-b19c-4381-84de-016a73c45805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:14.033443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:14.034323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:14.035155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:14.035155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:14.035155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:14.035155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:14.035155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:14.035155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:14.035155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:14.035155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:14.035747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 262/529] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:14.036496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbf803-b19c-4381-84de-016a73c45805 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:14.067902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6fe9f-6d88-4b78-9edf-f7e70b374592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:14.070463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6fe9f-6d88-4b78-9edf-f7e70b374592 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:14.074761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:14.177175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 268/530] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:14.177903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6fe9f-6d88-4b78-9edf-f7e70b374592 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:14.182246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbf803-b19c-4381-84de-016a73c45805 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:14.230887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cad2e-bc0f-431d-93aa-6c858f580216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:14.231858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cad2e-bc0f-431d-93aa-6c858f580216 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:14.232444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cad2e-bc0f-431d-93aa-6c858f580216 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:14.232972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cad2e-bc0f-431d-93aa-6c858f580216 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:14.233918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cad2e-bc0f-431d-93aa-6c858f580216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:14.234421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cad2e-bc0f-431d-93aa-6c858f580216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:14.236142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cad2e-bc0f-431d-93aa-6c858f580216 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:14.250540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 263/531] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:14.251665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cad2e-bc0f-431d-93aa-6c858f580216 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:14.280511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:14.308258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6fe9f-6d88-4b78-9edf-f7e70b374592 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:14.312184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:14.357609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4abae5-6aa4-45c7-ad49-742d0cd8118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:14.357609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4abae5-6aa4-45c7-ad49-742d0cd8118f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:14.357609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4abae5-6aa4-45c7-ad49-742d0cd8118f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:14.357609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4abae5-6aa4-45c7-ad49-742d0cd8118f None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:14.358245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4abae5-6aa4-45c7-ad49-742d0cd8118f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:14.358736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4abae5-6aa4-45c7-ad49-742d0cd8118f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:14.360505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4abae5-6aa4-45c7-ad49-742d0cd8118f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:14.376875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 269/532] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:14.378095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4abae5-6aa4-45c7-ad49-742d0cd8118f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:14.382307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cad2e-bc0f-431d-93aa-6c858f580216 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:14.421607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d1bce-f278-41a8-9d94-a82aacfe5a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:14.422532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d1bce-f278-41a8-9d94-a82aacfe5a36 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:14.422960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d1bce-f278-41a8-9d94-a82aacfe5a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:14.423375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d1bce-f278-41a8-9d94-a82aacfe5a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:14.434863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d1bce-f278-41a8-9d94-a82aacfe5a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:14.436670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d1bce-f278-41a8-9d94-a82aacfe5a36 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f52d1bce-f278-41a8-9d94-a82aacfe5a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:14.454855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:14.456726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:14.458675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:14.458675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:14.458675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:14.458675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:14.461709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 264/533] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:14.463393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d1bce-f278-41a8-9d94-a82aacfe5a36 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:14.505481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4abae5-6aa4-45c7-ad49-742d0cd8118f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:14.547779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf066-94ab-407b-b9f8-1a0568bf54e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:14.548615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf066-94ab-407b-b9f8-1a0568bf54e1 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:14.549362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf066-94ab-407b-b9f8-1a0568bf54e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:14.549742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf066-94ab-407b-b9f8-1a0568bf54e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:14.561172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bf066-94ab-407b-b9f8-1a0568bf54e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:14.563422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bf066-94ab-407b-b9f8-1a0568bf54e1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-ad4bf066-94ab-407b-b9f8-1a0568bf54e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:14.585203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:14.586995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:14.588671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:14.588671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:14.588671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:14.588671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:14.588671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:14.588671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:14.588671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:14.588671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:14.591954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:14.597871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 270/534] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:14.599675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf066-94ab-407b-b9f8-1a0568bf54e1 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:14.628127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d1bce-f278-41a8-9d94-a82aacfe5a36 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:14.646527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:14.667044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e8d7-cf11-4021-af3b-2878941e3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:14.667881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e8d7-cf11-4021-af3b-2878941e3af7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:14.668332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e8d7-cf11-4021-af3b-2878941e3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:14.668750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e8d7-cf11-4021-af3b-2878941e3af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:14.669702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154e8d7-cf11-4021-af3b-2878941e3af7 None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=e7b8eac1856c4e7f86fe1dea9f752719) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:14.670156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154e8d7-cf11-4021-af3b-2878941e3af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:14.671835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154e8d7-cf11-4021-af3b-2878941e3af7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:14.678105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 265/535] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:14 2022] GET /identity/v3/role_assignments?user.id=e7b8eac1856c4e7f86fe1dea9f752719&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:14.679659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e8d7-cf11-4021-af3b-2878941e3af7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:14.811482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf066-94ab-407b-b9f8-1a0568bf54e1 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:14.888877 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fef82-9b91-4c3a-b720-1146fe8696a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:14.889909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fef82-9b91-4c3a-b720-1146fe8696a0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:14.890338 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fef82-9b91-4c3a-b720-1146fe8696a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:14.890759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fef82-9b91-4c3a-b720-1146fe8696a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:14.891596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fef82-9b91-4c3a-b720-1146fe8696a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:14.893039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fef82-9b91-4c3a-b720-1146fe8696a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:14.895244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fef82-9b91-4c3a-b720-1146fe8696a0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:14.900952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e8d7-cf11-4021-af3b-2878941e3af7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:14.909960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 271/536] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:14.918311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fef82-9b91-4c3a-b720-1146fe8696a0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:14.963745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268e7f8-fea8-4653-8589-608c08b93f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:14.965277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268e7f8-fea8-4653-8589-608c08b93f2a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:14.966079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268e7f8-fea8-4653-8589-608c08b93f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:14.966829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268e7f8-fea8-4653-8589-608c08b93f2a None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:14.968635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268e7f8-fea8-4653-8589-608c08b93f2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:14.969453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268e7f8-fea8-4653-8589-608c08b93f2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:14.972478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268e7f8-fea8-4653-8589-608c08b93f2a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:15.007297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 266/537] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:15.013362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:15.017638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268e7f8-fea8-4653-8589-608c08b93f2a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:15.077834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:15.119401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fef82-9b91-4c3a-b720-1146fe8696a0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:15.178961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcb14c-c2d0-4e18-a7bc-d0a74da7f73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:15.180120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcb14c-c2d0-4e18-a7bc-d0a74da7f73c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:15.180601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcb14c-c2d0-4e18-a7bc-d0a74da7f73c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:15.181069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcb14c-c2d0-4e18-a7bc-d0a74da7f73c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:15.192984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcb14c-c2d0-4e18-a7bc-d0a74da7f73c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:15.196233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcb14c-c2d0-4e18-a7bc-d0a74da7f73c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:15.201874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268e7f8-fea8-4653-8589-608c08b93f2a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-c4bcb14c-c2d0-4e18-a7bc-d0a74da7f73c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:15.217273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:15.218886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:15.220599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:15.220599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:15.220599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:15.220599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:15.220599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:15.220599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:15.220599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:15.220599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:15.225698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 272/538] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:15.229185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcb14c-c2d0-4e18-a7bc-d0a74da7f73c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:15.268737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23975a-b70b-4167-bf33-fc0247f0ed80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:15.270265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23975a-b70b-4167-bf33-fc0247f0ed80 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:15.271013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23975a-b70b-4167-bf33-fc0247f0ed80 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:15.271716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23975a-b70b-4167-bf33-fc0247f0ed80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:15.274148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23975a-b70b-4167-bf33-fc0247f0ed80 None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=cc2ef9088a9941ddb4b163f282a1f7d1) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:15.275087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23975a-b70b-4167-bf33-fc0247f0ed80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:15.277941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23975a-b70b-4167-bf33-fc0247f0ed80 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:15.289317 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 267/539] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:15 2022] GET /identity/v3/role_assignments?user.id=cc2ef9088a9941ddb4b163f282a1f7d1&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:15.401424 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcb14c-c2d0-4e18-a7bc-d0a74da7f73c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:15.459089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fb1db-2750-4931-863c-582af005be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:15.460728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fb1db-2750-4931-863c-582af005be91 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:15.461194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fb1db-2750-4931-863c-582af005be91 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:15.461687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fb1db-2750-4931-863c-582af005be91 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:15.462950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fb1db-2750-4931-863c-582af005be91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:15.463463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fb1db-2750-4931-863c-582af005be91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:15.465912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fb1db-2750-4931-863c-582af005be91 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:15.493472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 273/540] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:15.497203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23975a-b70b-4167-bf33-fc0247f0ed80 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:15.590923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:15.644103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23975a-b70b-4167-bf33-fc0247f0ed80 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:15.679721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b7cc0-87a8-4587-a169-25f426967d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:15.680414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b7cc0-87a8-4587-a169-25f426967d4b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:15.680790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b7cc0-87a8-4587-a169-25f426967d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:15.681181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b7cc0-87a8-4587-a169-25f426967d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:15.682090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b7cc0-87a8-4587-a169-25f426967d4b None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=d110c27fc9c045ea9a4eb49b4dafe221) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:15.682497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b7cc0-87a8-4587-a169-25f426967d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:15.684047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b7cc0-87a8-4587-a169-25f426967d4b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:15.699187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 268/541] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:15 2022] GET /identity/v3/role_assignments?user.id=d110c27fc9c045ea9a4eb49b4dafe221&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:16.075193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677472-9836-47e9-9f51-797713ab465b None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:16.075710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677472-9836-47e9-9f51-797713ab465b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:16.076010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677472-9836-47e9-9f51-797713ab465b None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:16.077716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 274/542] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:16.083236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846b32-90f6-4062-af8c-7a89b2355fe6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:16.083673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846b32-90f6-4062-af8c-7a89b2355fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:16.083976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846b32-90f6-4062-af8c-7a89b2355fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:16.104807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-67846b32-90f6-4062-af8c-7a89b2355fe6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:16.106073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-67846b32-90f6-4062-af8c-7a89b2355fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:16.177545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 269/543] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:16.199779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b677472-9836-47e9-9f51-797713ab465b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:16.204332 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:16.329952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b677472-9836-47e9-9f51-797713ab465b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:16.364790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c769-3570-43f8-bacc-957b5276b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:16.365459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c769-3570-43f8-bacc-957b5276b345 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:16.365785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c769-3570-43f8-bacc-957b5276b345 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:16.366042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c769-3570-43f8-bacc-957b5276b345 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:16.376461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401c769-3570-43f8-bacc-957b5276b345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-4401c769-3570-43f8-bacc-957b5276b345 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:16.382186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:16.383045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:16.384237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 275/544] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:16.389961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67846b32-90f6-4062-af8c-7a89b2355fe6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:16.449637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:16.495611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67846b32-90f6-4062-af8c-7a89b2355fe6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:16.531012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d45b1-733b-4ef7-aa51-7b13f9afd3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:16.531626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d45b1-733b-4ef7-aa51-7b13f9afd3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:16.531904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d45b1-733b-4ef7-aa51-7b13f9afd3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:16.532181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d45b1-733b-4ef7-aa51-7b13f9afd3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:16.532891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d45b1-733b-4ef7-aa51-7b13f9afd3f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:16.533190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d45b1-733b-4ef7-aa51-7b13f9afd3f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:16.534597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d45b1-733b-4ef7-aa51-7b13f9afd3f8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:16.543390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 270/545] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:16.548811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c769-3570-43f8-bacc-957b5276b345 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:16.613917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:16.652768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c769-3570-43f8-bacc-957b5276b345 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:16.688218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2700f-be5a-457b-b578-8024f270fdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:16.688863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2700f-be5a-457b-b578-8024f270fdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:16.689143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2700f-be5a-457b-b578-8024f270fdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:16.689443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2700f-be5a-457b-b578-8024f270fdc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:16.700483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2700f-be5a-457b-b578-8024f270fdc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:16.703503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93870adf-4491-47ca-b465-457478b6d697 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:16.703785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93870adf-4491-47ca-b465-457478b6d697 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:16.704060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93870adf-4491-47ca-b465-457478b6d697 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:16.705597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 271/546] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:16.705701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2700f-be5a-457b-b578-8024f270fdc4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:16.710912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a3d92-e75c-4466-8947-205a56d1168c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:16.711201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a3d92-e75c-4466-8947-205a56d1168c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:16.711482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a3d92-e75c-4466-8947-205a56d1168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-78c2700f-be5a-457b-b578-8024f270fdc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:16.720728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:16.721595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:16.723297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:16.723297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:16.723297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:16.723297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:16.723297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 276/547] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:16.728124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2700f-be5a-457b-b578-8024f270fdc4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:16.765190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b80a3d92-e75c-4466-8947-205a56d1168c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:16.766415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b80a3d92-e75c-4466-8947-205a56d1168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:16.839860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2700f-be5a-457b-b578-8024f270fdc4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:16.858536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:16.876453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c84eb-0b8e-4b42-9691-832b539949b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:16.876997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c84eb-0b8e-4b42-9691-832b539949b6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:16.877277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c84eb-0b8e-4b42-9691-832b539949b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:16.877581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c84eb-0b8e-4b42-9691-832b539949b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:16.878278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c84eb-0b8e-4b42-9691-832b539949b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:16.878581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c84eb-0b8e-4b42-9691-832b539949b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:16.879936 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c84eb-0b8e-4b42-9691-832b539949b6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:16.893278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 277/548] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:16.899621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c84eb-0b8e-4b42-9691-832b539949b6 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.020983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c84eb-0b8e-4b42-9691-832b539949b6 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.023238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 272/549] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:17.054439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf634-9afa-4ded-a2e5-02b2adc2686d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.054819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf634-9afa-4ded-a2e5-02b2adc2686d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.054983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf634-9afa-4ded-a2e5-02b2adc2686d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.056571 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 273/550] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:17.057274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acf634-9afa-4ded-a2e5-02b2adc2686d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.059357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3ca50-1045-41f5-8c4d-359fe0891e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:17.060000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3ca50-1045-41f5-8c4d-359fe0891e67 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.060395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3ca50-1045-41f5-8c4d-359fe0891e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.060683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3ca50-1045-41f5-8c4d-359fe0891e67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.072548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3ca50-1045-41f5-8c4d-359fe0891e67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:17.074470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3ca50-1045-41f5-8c4d-359fe0891e67 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-34e3ca50-1045-41f5-8c4d-359fe0891e67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:17.087723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:17.089611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:17.090879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:17.093239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 278/551] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Aug 4 02:23:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:17.094728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dcd9b-1697-4669-ac64-db2f0ee54564 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.095161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dcd9b-1697-4669-ac64-db2f0ee54564 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.095555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dcd9b-1697-4669-ac64-db2f0ee54564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.114014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9b4dcd9b-1697-4669-ac64-db2f0ee54564 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:17.115445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9b4dcd9b-1697-4669-ac64-db2f0ee54564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:17.119525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:17.145404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:17.184438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acf634-9afa-4ded-a2e5-02b2adc2686d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.191284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 279/552] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:17.192382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dcd9b-1697-4669-ac64-db2f0ee54564 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.222282 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3efe3-963f-4e1a-a0c4-c2ded261597a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:17.223288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3efe3-963f-4e1a-a0c4-c2ded261597a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.223560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3efe3-963f-4e1a-a0c4-c2ded261597a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.223972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3efe3-963f-4e1a-a0c4-c2ded261597a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.237558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3efe3-963f-4e1a-a0c4-c2ded261597a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ead3efe3-963f-4e1a-a0c4-c2ded261597a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:17.244889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:17.245845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 274/553] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:17.247214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3efe3-963f-4e1a-a0c4-c2ded261597a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.321696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dcd9b-1697-4669-ac64-db2f0ee54564 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.356901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caf7c4-d180-40a1-b3fd-664b0062d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:17.357916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caf7c4-d180-40a1-b3fd-664b0062d738 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.358390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caf7c4-d180-40a1-b3fd-664b0062d738 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.358861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caf7c4-d180-40a1-b3fd-664b0062d738 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.359837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caf7c4-d180-40a1-b3fd-664b0062d738 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:17.360344 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caf7c4-d180-40a1-b3fd-664b0062d738 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:17.362049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caf7c4-d180-40a1-b3fd-664b0062d738 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:17.374849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3efe3-963f-4e1a-a0c4-c2ded261597a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.380539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 280/554] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:17.382243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caf7c4-d180-40a1-b3fd-664b0062d738 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.387478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:17.417647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71e152-6648-4986-a0e1-35559746f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:17.418195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e152-6648-4986-a0e1-35559746f295 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.418480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e152-6648-4986-a0e1-35559746f295 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.418749 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e152-6648-4986-a0e1-35559746f295 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.430008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71e152-6648-4986-a0e1-35559746f295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ab71e152-6648-4986-a0e1-35559746f295 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:17.434947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:17.435879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 275/555] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:17.437520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71e152-6648-4986-a0e1-35559746f295 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.438239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:17.494882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caf7c4-d180-40a1-b3fd-664b0062d738 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.530319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f36ebd-43df-4dec-9a41-b06a63eb7a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:17.531340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f36ebd-43df-4dec-9a41-b06a63eb7a3f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.531822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f36ebd-43df-4dec-9a41-b06a63eb7a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.532291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f36ebd-43df-4dec-9a41-b06a63eb7a3f None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.533193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f36ebd-43df-4dec-9a41-b06a63eb7a3f None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:17.533752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f36ebd-43df-4dec-9a41-b06a63eb7a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:17.535309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f36ebd-43df-4dec-9a41-b06a63eb7a3f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:17.544286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 281/556] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:17.545557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f36ebd-43df-4dec-9a41-b06a63eb7a3f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.556196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71e152-6648-4986-a0e1-35559746f295 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.600452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcab74-d395-4951-9dc8-f39c3a54ded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:17.601093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcab74-d395-4951-9dc8-f39c3a54ded8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.601399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcab74-d395-4951-9dc8-f39c3a54ded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.601674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcab74-d395-4951-9dc8-f39c3a54ded8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.616823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcab74-d395-4951-9dc8-f39c3a54ded8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:17.618643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbcab74-d395-4951-9dc8-f39c3a54ded8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-bfbcab74-d395-4951-9dc8-f39c3a54ded8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:17.638128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:17.639061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:17.641227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:17.641227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:17.641227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:17.641227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:17.641227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 276/557] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:17.641227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcab74-d395-4951-9dc8-f39c3a54ded8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.642889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:17.661373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f36ebd-43df-4dec-9a41-b06a63eb7a3f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.667978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:17.697053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de489b90-ba5d-40d8-b79c-b43a1c98108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:17.698365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de489b90-ba5d-40d8-b79c-b43a1c98108d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.698826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de489b90-ba5d-40d8-b79c-b43a1c98108d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.699276 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de489b90-ba5d-40d8-b79c-b43a1c98108d None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.700305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de489b90-ba5d-40d8-b79c-b43a1c98108d None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:17.700845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de489b90-ba5d-40d8-b79c-b43a1c98108d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:17.702447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de489b90-ba5d-40d8-b79c-b43a1c98108d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:17.715477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 282/558] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:17.716831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de489b90-ba5d-40d8-b79c-b43a1c98108d None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.776741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcab74-d395-4951-9dc8-f39c3a54ded8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.816370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7563-f1fa-4bc8-a477-6f56f5ac0d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:17.817027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7563-f1fa-4bc8-a477-6f56f5ac0d98 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.817303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7563-f1fa-4bc8-a477-6f56f5ac0d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.817598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7563-f1fa-4bc8-a477-6f56f5ac0d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.829936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e7563-f1fa-4bc8-a477-6f56f5ac0d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:17.831397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e7563-f1fa-4bc8-a477-6f56f5ac0d98 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:17.838956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de489b90-ba5d-40d8-b79c-b43a1c98108d None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-fc0e7563-f1fa-4bc8-a477-6f56f5ac0d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:17.846911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:17.848004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:17.849010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:17.849010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:17.849010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:17.849010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:17.849010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 277/559] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:17.849307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7563-f1fa-4bc8-a477-6f56f5ac0d98 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.881055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a193174-3f17-41c6-acae-57a8d3817e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:17.882261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a193174-3f17-41c6-acae-57a8d3817e11 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.882542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a193174-3f17-41c6-acae-57a8d3817e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.882821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a193174-3f17-41c6-acae-57a8d3817e11 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.883513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a193174-3f17-41c6-acae-57a8d3817e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:17.883821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a193174-3f17-41c6-acae-57a8d3817e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:17.885220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a193174-3f17-41c6-acae-57a8d3817e11 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:17.897721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 283/560] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:17.898722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e69b2-7d3c-4221-be1e-3b112fcab101 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:17.899004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e69b2-7d3c-4221-be1e-3b112fcab101 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:17.899276 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e69b2-7d3c-4221-be1e-3b112fcab101 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:17.900672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 284/561] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:17.902182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e69b2-7d3c-4221-be1e-3b112fcab101 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:17.915633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:17.929582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:17.962875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7563-f1fa-4bc8-a477-6f56f5ac0d98 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:17.999788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210166-fa90-4987-8180-fd6fee99083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.000845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210166-fa90-4987-8180-fd6fee99083a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.001170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210166-fa90-4987-8180-fd6fee99083a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.001657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210166-fa90-4987-8180-fd6fee99083a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.012812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f210166-fa90-4987-8180-fd6fee99083a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.014284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f210166-fa90-4987-8180-fd6fee99083a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.020668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e69b2-7d3c-4221-be1e-3b112fcab101 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4f210166-fa90-4987-8180-fd6fee99083a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:18.029854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:18.030872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:18.036902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:18.036902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:18.036902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:18.036902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:18.036902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 278/562] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:18.036902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210166-fa90-4987-8180-fd6fee99083a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.057142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d784b-3322-4826-a061-2e8cee6a07cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.057794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d784b-3322-4826-a061-2e8cee6a07cc None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.058184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d784b-3322-4826-a061-2e8cee6a07cc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.058458 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d784b-3322-4826-a061-2e8cee6a07cc None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.059192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d784b-3322-4826-a061-2e8cee6a07cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:18.059493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d784b-3322-4826-a061-2e8cee6a07cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.061044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d784b-3322-4826-a061-2e8cee6a07cc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.078198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 285/563] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:18.078198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d761bd0-a157-40aa-a962-7994a7e708b8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.078198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d761bd0-a157-40aa-a962-7994a7e708b8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.078198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d761bd0-a157-40aa-a962-7994a7e708b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.096602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-6d761bd0-a157-40aa-a962-7994a7e708b8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:18.097912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6d761bd0-a157-40aa-a962-7994a7e708b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:18.144917 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210166-fa90-4987-8180-fd6fee99083a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.164614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:18.170064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:18.179844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 286/564] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:18.179844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d761bd0-a157-40aa-a962-7994a7e708b8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.183512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b74ce1-a444-420d-a7d7-d6cf133b5576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.184238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b74ce1-a444-420d-a7d7-d6cf133b5576 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.184583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b74ce1-a444-420d-a7d7-d6cf133b5576 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.184927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b74ce1-a444-420d-a7d7-d6cf133b5576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.191739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b74ce1-a444-420d-a7d7-d6cf133b5576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.193251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b74ce1-a444-420d-a7d7-d6cf133b5576 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-b0b74ce1-a444-420d-a7d7-d6cf133b5576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:18.204645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:18.205773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 279/565] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:18.206656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b74ce1-a444-420d-a7d7-d6cf133b5576 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.278246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d761bd0-a157-40aa-a962-7994a7e708b8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.305304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b74ce1-a444-420d-a7d7-d6cf133b5576 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.310839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57137a4b-7fa7-4c41-ae06-c070b7862af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.311448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57137a4b-7fa7-4c41-ae06-c070b7862af4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.311726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57137a4b-7fa7-4c41-ae06-c070b7862af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.312002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57137a4b-7fa7-4c41-ae06-c070b7862af4 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.312684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57137a4b-7fa7-4c41-ae06-c070b7862af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:18.312984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57137a4b-7fa7-4c41-ae06-c070b7862af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.314388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57137a4b-7fa7-4c41-ae06-c070b7862af4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.325799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 287/566] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:18.326946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea35c78-7865-42c2-8f89-0ba40c4122ea None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.327229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea35c78-7865-42c2-8f89-0ba40c4122ea None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.327508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea35c78-7865-42c2-8f89-0ba40c4122ea None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.328713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 288/567] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:18.329425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea35c78-7865-42c2-8f89-0ba40c4122ea None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.341053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb2f12-e70d-4ee4-89d4-f808262df06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.341741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb2f12-e70d-4ee4-89d4-f808262df06b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.342024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb2f12-e70d-4ee4-89d4-f808262df06b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.342660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb2f12-e70d-4ee4-89d4-f808262df06b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.350108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb2f12-e70d-4ee4-89d4-f808262df06b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.351552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb2f12-e70d-4ee4-89d4-f808262df06b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ccfb2f12-e70d-4ee4-89d4-f808262df06b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:18.362662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:18.363771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 280/568] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:18.364880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb2f12-e70d-4ee4-89d4-f808262df06b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.392308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:18.409314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:18.434383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea35c78-7865-42c2-8f89-0ba40c4122ea None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.466216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb2f12-e70d-4ee4-89d4-f808262df06b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.468119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f09eb-98e0-4331-b0e5-628e66c466a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.468825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f09eb-98e0-4331-b0e5-628e66c466a3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.469177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f09eb-98e0-4331-b0e5-628e66c466a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.469495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f09eb-98e0-4331-b0e5-628e66c466a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.479343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f09eb-98e0-4331-b0e5-628e66c466a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-819f09eb-98e0-4331-b0e5-628e66c466a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:18.485288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:18.486390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 289/569] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:18.488022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f09eb-98e0-4331-b0e5-628e66c466a3 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.502349 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778604b-294b-4f1c-bb76-8417ed53ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.502968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778604b-294b-4f1c-bb76-8417ed53ef00 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.503338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778604b-294b-4f1c-bb76-8417ed53ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.503608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778604b-294b-4f1c-bb76-8417ed53ef00 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.504349 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778604b-294b-4f1c-bb76-8417ed53ef00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:18.504671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778604b-294b-4f1c-bb76-8417ed53ef00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.506130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778604b-294b-4f1c-bb76-8417ed53ef00 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.519143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 281/570] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:18.520325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91999018-4d5d-4079-aeda-64f8e8107eea None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.520610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91999018-4d5d-4079-aeda-64f8e8107eea None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.520877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91999018-4d5d-4079-aeda-64f8e8107eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.537741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-91999018-4d5d-4079-aeda-64f8e8107eea None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:18.538919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-91999018-4d5d-4079-aeda-64f8e8107eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:18.594977 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f09eb-98e0-4331-b0e5-628e66c466a3 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.607313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 282/571] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:18.608145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91999018-4d5d-4079-aeda-64f8e8107eea None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.612709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:18.631189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed7172-81c2-4ca7-9fd2-4ebdabea3c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.631822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed7172-81c2-4ca7-9fd2-4ebdabea3c35 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.632098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed7172-81c2-4ca7-9fd2-4ebdabea3c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.632368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed7172-81c2-4ca7-9fd2-4ebdabea3c35 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.637301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:18.639899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed7172-81c2-4ca7-9fd2-4ebdabea3c35 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.641391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed7172-81c2-4ca7-9fd2-4ebdabea3c35 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-27ed7172-81c2-4ca7-9fd2-4ebdabea3c35 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:18.652766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:18.653908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 290/572] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:18.655371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed7172-81c2-4ca7-9fd2-4ebdabea3c35 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.707863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91999018-4d5d-4079-aeda-64f8e8107eea None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.741932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7f336-8d41-43f5-9901-d8ca4176c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.742644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7f336-8d41-43f5-9901-d8ca4176c03e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.742933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7f336-8d41-43f5-9901-d8ca4176c03e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.743204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7f336-8d41-43f5-9901-d8ca4176c03e None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.743978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7f336-8d41-43f5-9901-d8ca4176c03e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:18.744277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7f336-8d41-43f5-9901-d8ca4176c03e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.749924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7f336-8d41-43f5-9901-d8ca4176c03e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.752755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed7172-81c2-4ca7-9fd2-4ebdabea3c35 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.771179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 283/573] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:18.771987 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7f336-8d41-43f5-9901-d8ca4176c03e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.786290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ab58-9ee8-4b47-ac09-01c018f72f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.786904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ab58-9ee8-4b47-ac09-01c018f72f6b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.787200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ab58-9ee8-4b47-ac09-01c018f72f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.787499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31ab58-9ee8-4b47-ac09-01c018f72f6b None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.788205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31ab58-9ee8-4b47-ac09-01c018f72f6b None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:18.788514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31ab58-9ee8-4b47-ac09-01c018f72f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.789906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31ab58-9ee8-4b47-ac09-01c018f72f6b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.797948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 291/574] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:18.798719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ab58-9ee8-4b47-ac09-01c018f72f6b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.839133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:18.865029 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:18.875219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7f336-8d41-43f5-9901-d8ca4176c03e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.895870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31ab58-9ee8-4b47-ac09-01c018f72f6b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:18.908037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22869c63-cd5a-44dc-8c31-ec51fb29421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.908696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22869c63-cd5a-44dc-8c31-ec51fb29421f None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.908973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22869c63-cd5a-44dc-8c31-ec51fb29421f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.909247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22869c63-cd5a-44dc-8c31-ec51fb29421f None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/b0096da9bf564ceca61af67cac713f30/roles/a60b7cc5e9e5429aafb8b22f5712c493` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.923742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22869c63-cd5a-44dc-8c31-ec51fb29421f None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=b0096da9bf564ceca61af67cac713f30, role_id=a60b7cc5e9e5429aafb8b22f5712c493)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:18.925192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22869c63-cd5a-44dc-8c31-ec51fb29421f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:18.929819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb499955-2604-4074-8a67-1f75345d6152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:18.930537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb499955-2604-4074-8a67-1f75345d6152 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:18.930918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb499955-2604-4074-8a67-1f75345d6152 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:18.931224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb499955-2604-4074-8a67-1f75345d6152 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:18.938328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 284/575] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:23:18 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/b0096da9bf564ceca61af67cac713f30/roles/a60b7cc5e9e5429aafb8b22f5712c493 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:23:18.939115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22869c63-cd5a-44dc-8c31-ec51fb29421f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:18.952026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb499955-2604-4074-8a67-1f75345d6152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-fb499955-2604-4074-8a67-1f75345d6152 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:18.957851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:18.959136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:18.960241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:18.961480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 292/576] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:18.963505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb499955-2604-4074-8a67-1f75345d6152 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.057711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22869c63-cd5a-44dc-8c31-ec51fb29421f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.077510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:19.081241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb499955-2604-4074-8a67-1f75345d6152 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.100694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b634c-083e-4df1-ab64-c98cddc2200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.101348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b634c-083e-4df1-ab64-c98cddc2200e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.101623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b634c-083e-4df1-ab64-c98cddc2200e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.101901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b634c-083e-4df1-ab64-c98cddc2200e None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.102700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b634c-083e-4df1-ab64-c98cddc2200e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:19.103009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b634c-083e-4df1-ab64-c98cddc2200e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.104452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b634c-083e-4df1-ab64-c98cddc2200e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.114509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:19.122954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece44cbc-f8c0-4719-81b3-b8c6801fe400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.123577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece44cbc-f8c0-4719-81b3-b8c6801fe400 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.123854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece44cbc-f8c0-4719-81b3-b8c6801fe400 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.124135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece44cbc-f8c0-4719-81b3-b8c6801fe400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.129394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 285/577] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:19.129394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b634c-083e-4df1-ab64-c98cddc2200e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.199472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece44cbc-f8c0-4719-81b3-b8c6801fe400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.200941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece44cbc-f8c0-4719-81b3-b8c6801fe400 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.231748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b634c-083e-4df1-ab64-c98cddc2200e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.268037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818184-c2cb-4114-a1f2-7c52ff7aa729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.268929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818184-c2cb-4114-a1f2-7c52ff7aa729 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.269206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818184-c2cb-4114-a1f2-7c52ff7aa729 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.269520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818184-c2cb-4114-a1f2-7c52ff7aa729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.281483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818184-c2cb-4114-a1f2-7c52ff7aa729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.283028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818184-c2cb-4114-a1f2-7c52ff7aa729 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c3818184-c2cb-4114-a1f2-7c52ff7aa729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:19.299400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:19.300460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:19.301322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:19.301322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:19.301322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:19.301322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:19.301322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 286/578] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:19.301322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818184-c2cb-4114-a1f2-7c52ff7aa729 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.311908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:19.320615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 293/579] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:19.321516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece44cbc-f8c0-4719-81b3-b8c6801fe400 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.355255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:19.411055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818184-c2cb-4114-a1f2-7c52ff7aa729 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.426923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece44cbc-f8c0-4719-81b3-b8c6801fe400 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.446792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea1948-f444-465f-bd40-0e606153007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.447400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea1948-f444-465f-bd40-0e606153007d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.447674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea1948-f444-465f-bd40-0e606153007d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.447940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea1948-f444-465f-bd40-0e606153007d None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.448642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea1948-f444-465f-bd40-0e606153007d None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:19.448940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea1948-f444-465f-bd40-0e606153007d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.450711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea1948-f444-465f-bd40-0e606153007d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.461207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd09ac-6c76-4348-94b9-c78138c073c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.461884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd09ac-6c76-4348-94b9-c78138c073c9 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.462161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd09ac-6c76-4348-94b9-c78138c073c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.462432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd09ac-6c76-4348-94b9-c78138c073c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.464193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 287/580] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:19.465142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea1948-f444-465f-bd40-0e606153007d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.472699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd09ac-6c76-4348-94b9-c78138c073c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.474170 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd09ac-6c76-4348-94b9-c78138c073c9 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-9ecd09ac-6c76-4348-94b9-c78138c073c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:19.489534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:19.490656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:19.496490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:19.496490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:19.496490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:19.496490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:19.496490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 294/581] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:19.496490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd09ac-6c76-4348-94b9-c78138c073c9 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.548410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:19.578750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea1948-f444-465f-bd40-0e606153007d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.593264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:19.603136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd09ac-6c76-4348-94b9-c78138c073c9 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.616389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684e35a-b390-4639-b357-f56dc75429d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.617005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684e35a-b390-4639-b357-f56dc75429d0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.617536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684e35a-b390-4639-b357-f56dc75429d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.617667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684e35a-b390-4639-b357-f56dc75429d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.618311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684e35a-b390-4639-b357-f56dc75429d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:19.618552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684e35a-b390-4639-b357-f56dc75429d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.619956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684e35a-b390-4639-b357-f56dc75429d0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.636686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 288/582] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:19.636686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684e35a-b390-4639-b357-f56dc75429d0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.643484 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7ad7-dced-454b-9813-b421da6cb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.644200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7ad7-dced-454b-9813-b421da6cb4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.644557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7ad7-dced-454b-9813-b421da6cb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.644908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7ad7-dced-454b-9813-b421da6cb4f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.657090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca7ad7-dced-454b-9813-b421da6cb4f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.658689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca7ad7-dced-454b-9813-b421da6cb4f6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-43ca7ad7-dced-454b-9813-b421da6cb4f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:19.673566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:19.674478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:19.675352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:19.675352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:19.675352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:19.675352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:19.679693 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 295/583] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:19.680148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7ad7-dced-454b-9813-b421da6cb4f6 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.742353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684e35a-b390-4639-b357-f56dc75429d0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.780341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a26b2-3813-482a-8103-f02f5905c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.781081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a26b2-3813-482a-8103-f02f5905c946 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.781385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a26b2-3813-482a-8103-f02f5905c946 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.781667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a26b2-3813-482a-8103-f02f5905c946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.784661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7ad7-dced-454b-9813-b421da6cb4f6 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.787035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:19.793710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a26b2-3813-482a-8103-f02f5905c946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.795271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a26b2-3813-482a-8103-f02f5905c946 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-407a26b2-3813-482a-8103-f02f5905c946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:19.810676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:19.811706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:19.817369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:19.817369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:19.817369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:19.817369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:19.817369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 289/584] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:19.817369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a26b2-3813-482a-8103-f02f5905c946 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.826117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac73ac-8cc0-4fa1-8cd8-661a87df52c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.826807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac73ac-8cc0-4fa1-8cd8-661a87df52c2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.827164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac73ac-8cc0-4fa1-8cd8-661a87df52c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.827522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac73ac-8cc0-4fa1-8cd8-661a87df52c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.828216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac73ac-8cc0-4fa1-8cd8-661a87df52c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:19.828521 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac73ac-8cc0-4fa1-8cd8-661a87df52c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.829928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac73ac-8cc0-4fa1-8cd8-661a87df52c2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.843074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:19.843212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 296/585] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:19.848153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac73ac-8cc0-4fa1-8cd8-661a87df52c2 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.922048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a26b2-3813-482a-8103-f02f5905c946 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.947551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac73ac-8cc0-4fa1-8cd8-661a87df52c2 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:19.956954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e82f82-4a0d-43d1-ac29-15196a779037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.957613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e82f82-4a0d-43d1-ac29-15196a779037 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.957901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e82f82-4a0d-43d1-ac29-15196a779037 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.958175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e82f82-4a0d-43d1-ac29-15196a779037 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.966234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e82f82-4a0d-43d1-ac29-15196a779037 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.967673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e82f82-4a0d-43d1-ac29-15196a779037 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-98e82f82-4a0d-43d1-ac29-15196a779037 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:19.978825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:19.979937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:19.980992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 290/586] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:19.985804 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e82f82-4a0d-43d1-ac29-15196a779037 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:19.988269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe42c4b-3a64-4cd1-8705-b7b6c5fe481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:19.988880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe42c4b-3a64-4cd1-8705-b7b6c5fe481b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:19.989153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe42c4b-3a64-4cd1-8705-b7b6c5fe481b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:19.989455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe42c4b-3a64-4cd1-8705-b7b6c5fe481b None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:19.990144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe42c4b-3a64-4cd1-8705-b7b6c5fe481b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:19.990963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe42c4b-3a64-4cd1-8705-b7b6c5fe481b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:19.992464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe42c4b-3a64-4cd1-8705-b7b6c5fe481b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.010460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 297/587] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:20.010460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe42c4b-3a64-4cd1-8705-b7b6c5fe481b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.038252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:20.083160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:20.100474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e82f82-4a0d-43d1-ac29-15196a779037 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.122092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe42c4b-3a64-4cd1-8705-b7b6c5fe481b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.137760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a42bd-dbc4-4c06-8a47-419967d1a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.138372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a42bd-dbc4-4c06-8a47-419967d1a657 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.138651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a42bd-dbc4-4c06-8a47-419967d1a657 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.138922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a42bd-dbc4-4c06-8a47-419967d1a657 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.139600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a42bd-dbc4-4c06-8a47-419967d1a657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:20.139897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a42bd-dbc4-4c06-8a47-419967d1a657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.141247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a42bd-dbc4-4c06-8a47-419967d1a657 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.157961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 291/588] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:20.157961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a42bd-dbc4-4c06-8a47-419967d1a657 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.162589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a45d70-0b96-42b9-9649-58bb1bcace81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.163233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a45d70-0b96-42b9-9649-58bb1bcace81 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.163513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a45d70-0b96-42b9-9649-58bb1bcace81 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.163787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a45d70-0b96-42b9-9649-58bb1bcace81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.170889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a45d70-0b96-42b9-9649-58bb1bcace81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.172723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a45d70-0b96-42b9-9649-58bb1bcace81 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-15a45d70-0b96-42b9-9649-58bb1bcace81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:20.188053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:20.189117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 298/589] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:20.195422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a45d70-0b96-42b9-9649-58bb1bcace81 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.267409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a42bd-dbc4-4c06-8a47-419967d1a657 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.281898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:20.299095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a45d70-0b96-42b9-9649-58bb1bcace81 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.305485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633117de-adc6-408c-8135-358877119b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.306103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633117de-adc6-408c-8135-358877119b95 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.306382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633117de-adc6-408c-8135-358877119b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.306655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633117de-adc6-408c-8135-358877119b95 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.307445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633117de-adc6-408c-8135-358877119b95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:20.307751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633117de-adc6-408c-8135-358877119b95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.309170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633117de-adc6-408c-8135-358877119b95 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.332520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 292/590] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:20.333458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633117de-adc6-408c-8135-358877119b95 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.333932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c07b0-8c2b-4503-ba95-aad001c3b277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.334564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c07b0-8c2b-4503-ba95-aad001c3b277 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.334839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c07b0-8c2b-4503-ba95-aad001c3b277 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.335108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c07b0-8c2b-4503-ba95-aad001c3b277 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.336182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:20.342852 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c07b0-8c2b-4503-ba95-aad001c3b277 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.344273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c07b0-8c2b-4503-ba95-aad001c3b277 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-914c07b0-8c2b-4503-ba95-aad001c3b277 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:20.356336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:20.357252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 299/591] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:20.358773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c07b0-8c2b-4503-ba95-aad001c3b277 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.445508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633117de-adc6-408c-8135-358877119b95 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.457909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c07b0-8c2b-4503-ba95-aad001c3b277 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.481924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955e66b-8fa2-497e-868c-f83fe4ff9016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.482847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955e66b-8fa2-497e-868c-f83fe4ff9016 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.483133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955e66b-8fa2-497e-868c-f83fe4ff9016 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.483524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955e66b-8fa2-497e-868c-f83fe4ff9016 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.491921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955e66b-8fa2-497e-868c-f83fe4ff9016 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.493496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955e66b-8fa2-497e-868c-f83fe4ff9016 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.494929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50044d0d-952c-4d0b-be10-cc3ec59d80bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.495547 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50044d0d-952c-4d0b-be10-cc3ec59d80bf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.495830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50044d0d-952c-4d0b-be10-cc3ec59d80bf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.496109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50044d0d-952c-4d0b-be10-cc3ec59d80bf None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.496858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50044d0d-952c-4d0b-be10-cc3ec59d80bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:20.497164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50044d0d-952c-4d0b-be10-cc3ec59d80bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.499859 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50044d0d-952c-4d0b-be10-cc3ec59d80bf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f955e66b-8fa2-497e-868c-f83fe4ff9016 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:20.506062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:20.506971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:23:20.507915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:20.509216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 293/592] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:20.510058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955e66b-8fa2-497e-868c-f83fe4ff9016 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.517100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 300/593] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:20.518236 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50044d0d-952c-4d0b-be10-cc3ec59d80bf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.524022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:20.576761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:20.620964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955e66b-8fa2-497e-868c-f83fe4ff9016 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.637883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50044d0d-952c-4d0b-be10-cc3ec59d80bf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.656975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f77d4-52f2-4b80-bf82-02992135de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.657841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f77d4-52f2-4b80-bf82-02992135de01 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.658281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f77d4-52f2-4b80-bf82-02992135de01 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.658559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f77d4-52f2-4b80-bf82-02992135de01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.669822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f77d4-52f2-4b80-bf82-02992135de01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.671337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f77d4-52f2-4b80-bf82-02992135de01 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.673172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa848-7330-4a1a-93a6-155f523f2fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.673809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa848-7330-4a1a-93a6-155f523f2fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.674091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa848-7330-4a1a-93a6-155f523f2fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.674360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa848-7330-4a1a-93a6-155f523f2fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.675093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa848-7330-4a1a-93a6-155f523f2fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:20.675393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa848-7330-4a1a-93a6-155f523f2fb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.676786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa848-7330-4a1a-93a6-155f523f2fb6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-623f77d4-52f2-4b80-bf82-02992135de01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:20.687510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:20.688411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:20.689291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:20.689291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:20.689291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:20.689291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:20.689544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 301/594] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:20.689902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa848-7330-4a1a-93a6-155f523f2fb6 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.691281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 294/595] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:20.692200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f77d4-52f2-4b80-bf82-02992135de01 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.759606 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:20.798014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f77d4-52f2-4b80-bf82-02992135de01 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.803675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa848-7330-4a1a-93a6-155f523f2fb6 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:20.812548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:20.835609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403455-a380-481f-a365-cfcd18364aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.836272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403455-a380-481f-a365-cfcd18364aef None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.836549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403455-a380-481f-a365-cfcd18364aef None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.836830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403455-a380-481f-a365-cfcd18364aef None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/e7b8eac1856c4e7f86fe1dea9f752719/roles/a60b7cc5e9e5429aafb8b22f5712c493` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.841099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6042b5c-e1b2-412b-b7ea-6fd8dd950392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:20.841972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6042b5c-e1b2-412b-b7ea-6fd8dd950392 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:20.842453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6042b5c-e1b2-412b-b7ea-6fd8dd950392 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:20.842918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6042b5c-e1b2-412b-b7ea-6fd8dd950392 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:20.843891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6042b5c-e1b2-412b-b7ea-6fd8dd950392 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:20.844407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6042b5c-e1b2-412b-b7ea-6fd8dd950392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.846061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6042b5c-e1b2-412b-b7ea-6fd8dd950392 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.852846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403455-a380-481f-a365-cfcd18364aef None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=e7b8eac1856c4e7f86fe1dea9f752719, role_id=a60b7cc5e9e5429aafb8b22f5712c493)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:20.854303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403455-a380-481f-a365-cfcd18364aef None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:20.870596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 295/596] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:23:20 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/e7b8eac1856c4e7f86fe1dea9f752719/roles/a60b7cc5e9e5429aafb8b22f5712c493 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:23:20.870596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403455-a380-481f-a365-cfcd18364aef None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.871365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 302/597] 10.222.0.69 () {56 vars in 1139 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:20.872543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6042b5c-e1b2-412b-b7ea-6fd8dd950392 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:20.999297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6042b5c-e1b2-412b-b7ea-6fd8dd950392 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.002352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403455-a380-481f-a365-cfcd18364aef None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.024683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:21.041230 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468aea5-3efe-4268-ba07-52dd8f9b883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.042050 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468aea5-3efe-4268-ba07-52dd8f9b883b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.042659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468aea5-3efe-4268-ba07-52dd8f9b883b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.042940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468aea5-3efe-4268-ba07-52dd8f9b883b None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.043785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468aea5-3efe-4268-ba07-52dd8f9b883b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:21.044095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468aea5-3efe-4268-ba07-52dd8f9b883b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:21.045534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468aea5-3efe-4268-ba07-52dd8f9b883b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:21.050139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fd1e9-3774-4388-b59e-285c2f484f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.050691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fd1e9-3774-4388-b59e-285c2f484f3e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.050968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fd1e9-3774-4388-b59e-285c2f484f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.051237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fd1e9-3774-4388-b59e-285c2f484f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.052014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fd1e9-3774-4388-b59e-285c2f484f3e None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=d7e996ea899e4bf8a65b721628a044ec) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:21.052320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fd1e9-3774-4388-b59e-285c2f484f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:21.053822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fd1e9-3774-4388-b59e-285c2f484f3e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:21.057733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 303/598] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:21.058642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468aea5-3efe-4268-ba07-52dd8f9b883b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.063068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 296/599] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:20 2022] GET /identity/v3/role_assignments?user.id=d7e996ea899e4bf8a65b721628a044ec&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:21.064146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7040d-072c-4fa2-a6bc-11d087868c3d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.064426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7040d-072c-4fa2-a6bc-11d087868c3d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.064697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7040d-072c-4fa2-a6bc-11d087868c3d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.066202 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 297/600] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:21.071708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7040d-072c-4fa2-a6bc-11d087868c3d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.104747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:21.178861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468aea5-3efe-4268-ba07-52dd8f9b883b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.190729 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7040d-072c-4fa2-a6bc-11d087868c3d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.219233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456319d2-f7c4-42e0-ba35-718435446e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.220128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456319d2-f7c4-42e0-ba35-718435446e21 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.220584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456319d2-f7c4-42e0-ba35-718435446e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.221007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456319d2-f7c4-42e0-ba35-718435446e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.232884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456319d2-f7c4-42e0-ba35-718435446e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:21.234904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456319d2-f7c4-42e0-ba35-718435446e21 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:21.235115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbdb77-d5fe-4d99-b592-fff1feeadb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.235760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbdb77-d5fe-4d99-b592-fff1feeadb81 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.236086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbdb77-d5fe-4d99-b592-fff1feeadb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.236600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbdb77-d5fe-4d99-b592-fff1feeadb81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.249582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbdb77-d5fe-4d99-b592-fff1feeadb81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-456319d2-f7c4-42e0-ba35-718435446e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:21.250640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:21.252630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:21.253761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:21.253761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:21.253761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:21.253761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:21.254027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbdb77-d5fe-4d99-b592-fff1feeadb81 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:21.254125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 304/601] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:21.254125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52305ce-b3d7-420b-9c1d-80fbf1e56eae None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.254125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52305ce-b3d7-420b-9c1d-80fbf1e56eae None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.254125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52305ce-b3d7-420b-9c1d-80fbf1e56eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-31fbdb77-d5fe-4d99-b592-fff1feeadb81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:21.269482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:21.270890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:21.272635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:21.272635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:21.272635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:21.272635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:21.272635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:21.272635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:21.272635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:21.272635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:21.272635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 298/602] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:21.273233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbdb77-d5fe-4d99-b592-fff1feeadb81 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.276326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e52305ce-b3d7-420b-9c1d-80fbf1e56eae None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:21.278799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e52305ce-b3d7-420b-9c1d-80fbf1e56eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:21.315741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:21.364894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 305/603] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:21.366622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52305ce-b3d7-420b-9c1d-80fbf1e56eae None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.393067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:21.413786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbdb77-d5fe-4d99-b592-fff1feeadb81 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.449003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6ca20-daf4-4e16-a37a-2dd04c1aab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.449751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ca20-daf4-4e16-a37a-2dd04c1aab69 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.450102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ca20-daf4-4e16-a37a-2dd04c1aab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.450443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ca20-daf4-4e16-a37a-2dd04c1aab69 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.451200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6ca20-daf4-4e16-a37a-2dd04c1aab69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:21.451574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6ca20-daf4-4e16-a37a-2dd04c1aab69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:21.452998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6ca20-daf4-4e16-a37a-2dd04c1aab69 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:21.467538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 299/604] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:21.468706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6ca20-daf4-4e16-a37a-2dd04c1aab69 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.475987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52305ce-b3d7-420b-9c1d-80fbf1e56eae None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.512084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc0a3-7793-4b35-827c-afed5bd9c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.512707 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc0a3-7793-4b35-827c-afed5bd9c358 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.512984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc0a3-7793-4b35-827c-afed5bd9c358 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.513256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc0a3-7793-4b35-827c-afed5bd9c358 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.514177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc0a3-7793-4b35-827c-afed5bd9c358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:21.514486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc0a3-7793-4b35-827c-afed5bd9c358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:21.516024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc0a3-7793-4b35-827c-afed5bd9c358 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:21.529688 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 306/605] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:21.530608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc0a3-7793-4b35-827c-afed5bd9c358 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.557099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:21.580017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6ca20-daf4-4e16-a37a-2dd04c1aab69 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.617308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50758d-f3cd-46cf-84fc-5ed5c80b7825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.618371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50758d-f3cd-46cf-84fc-5ed5c80b7825 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.618871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50758d-f3cd-46cf-84fc-5ed5c80b7825 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.619397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50758d-f3cd-46cf-84fc-5ed5c80b7825 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.630866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50758d-f3cd-46cf-84fc-5ed5c80b7825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-6b50758d-f3cd-46cf-84fc-5ed5c80b7825 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:21.636434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:21.637350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:21.638249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:21.645174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc0a3-7793-4b35-827c-afed5bd9c358 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.645753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 300/606] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:21.647310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50758d-f3cd-46cf-84fc-5ed5c80b7825 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.659389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:21.681254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d248c-b085-463c-a8f3-59059fb276f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.682015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d248c-b085-463c-a8f3-59059fb276f4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.682302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d248c-b085-463c-a8f3-59059fb276f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.682575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d248c-b085-463c-a8f3-59059fb276f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.689817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d248c-b085-463c-a8f3-59059fb276f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:21.691255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d248c-b085-463c-a8f3-59059fb276f4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-878d248c-b085-463c-a8f3-59059fb276f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:21.704339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:21.705248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:21.706158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:21.706158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:21.706158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:21.706158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:21.706158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:21.706158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:21.706158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:21.706158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:21.706158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 307/607] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:21.707169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d248c-b085-463c-a8f3-59059fb276f4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.760650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50758d-f3cd-46cf-84fc-5ed5c80b7825 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.797320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce39366-7504-4312-afb4-30f82bedb795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.798257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce39366-7504-4312-afb4-30f82bedb795 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.798748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce39366-7504-4312-afb4-30f82bedb795 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.799199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce39366-7504-4312-afb4-30f82bedb795 None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/cc2ef9088a9941ddb4b163f282a1f7d1/roles/a60b7cc5e9e5429aafb8b22f5712c493` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.804282 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:21.816502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce39366-7504-4312-afb4-30f82bedb795 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=cc2ef9088a9941ddb4b163f282a1f7d1, role_id=a60b7cc5e9e5429aafb8b22f5712c493)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:21.819590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce39366-7504-4312-afb4-30f82bedb795 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:21.821272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d248c-b085-463c-a8f3-59059fb276f4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:21.839841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 301/608] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:23:21 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/cc2ef9088a9941ddb4b163f282a1f7d1/roles/a60b7cc5e9e5429aafb8b22f5712c493 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:23:21.840922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce39366-7504-4312-afb4-30f82bedb795 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.858933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f3a5d-98a0-45f6-b4c6-8066dbd21229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:21.859652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f3a5d-98a0-45f6-b4c6-8066dbd21229 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:21.859998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f3a5d-98a0-45f6-b4c6-8066dbd21229 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:21.860347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f3a5d-98a0-45f6-b4c6-8066dbd21229 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:21.861240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f3a5d-98a0-45f6-b4c6-8066dbd21229 None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:21.861647 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f3a5d-98a0-45f6-b4c6-8066dbd21229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:21.863172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f3a5d-98a0-45f6-b4c6-8066dbd21229 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:21.873201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 308/609] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:21.879617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f3a5d-98a0-45f6-b4c6-8066dbd21229 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:21.927143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:21.992569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f3a5d-98a0-45f6-b4c6-8066dbd21229 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:22.020154 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce39366-7504-4312-afb4-30f82bedb795 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:22.038997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348d288-4c31-4378-ad37-02d76f7a2564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:22.040061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348d288-4c31-4378-ad37-02d76f7a2564 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:22.040544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348d288-4c31-4378-ad37-02d76f7a2564 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:22.041112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348d288-4c31-4378-ad37-02d76f7a2564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:22.061066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348d288-4c31-4378-ad37-02d76f7a2564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:22.063038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348d288-4c31-4378-ad37-02d76f7a2564 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:22.071832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-c348d288-4c31-4378-ad37-02d76f7a2564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:22.082690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:22.083713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:22.085172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:22.085172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:22.085172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:22.085172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:22.089622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 309/610] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:22.092396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348d288-4c31-4378-ad37-02d76f7a2564 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:22.105648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e139dfd-1d8a-47b2-9476-e0d516a5a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:22.106581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e139dfd-1d8a-47b2-9476-e0d516a5a8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:22.107059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e139dfd-1d8a-47b2-9476-e0d516a5a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:22.107609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e139dfd-1d8a-47b2-9476-e0d516a5a8a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:22.108566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e139dfd-1d8a-47b2-9476-e0d516a5a8a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:22.109039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e139dfd-1d8a-47b2-9476-e0d516a5a8a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:22.110811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e139dfd-1d8a-47b2-9476-e0d516a5a8a7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:22.124670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 302/611] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:22.134410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e139dfd-1d8a-47b2-9476-e0d516a5a8a7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:22.213770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348d288-4c31-4378-ad37-02d76f7a2564 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:22.268890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e139dfd-1d8a-47b2-9476-e0d516a5a8a7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:22.289503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:22.311272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f772d9-9b3b-412f-9a58-0fc97f7d896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:22.311892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f772d9-9b3b-412f-9a58-0fc97f7d896c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:22.312171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f772d9-9b3b-412f-9a58-0fc97f7d896c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:22.312446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f772d9-9b3b-412f-9a58-0fc97f7d896c None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:22.313609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff7f71-79a0-407a-b681-0fed3faf48f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:22.314261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff7f71-79a0-407a-b681-0fed3faf48f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:22.314532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff7f71-79a0-407a-b681-0fed3faf48f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:22.314799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff7f71-79a0-407a-b681-0fed3faf48f7 None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/d110c27fc9c045ea9a4eb49b4dafe221/roles/a60b7cc5e9e5429aafb8b22f5712c493` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:22.315600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f772d9-9b3b-412f-9a58-0fc97f7d896c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:22.315901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f772d9-9b3b-412f-9a58-0fc97f7d896c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:22.318090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f772d9-9b3b-412f-9a58-0fc97f7d896c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:22.346623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff7f71-79a0-407a-b681-0fed3faf48f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=d110c27fc9c045ea9a4eb49b4dafe221, role_id=a60b7cc5e9e5429aafb8b22f5712c493)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:22.347985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff7f71-79a0-407a-b681-0fed3faf48f7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:22.348570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 310/612] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:22.351795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f772d9-9b3b-412f-9a58-0fc97f7d896c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:22.381481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 303/613] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:23:22 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/d110c27fc9c045ea9a4eb49b4dafe221/roles/a60b7cc5e9e5429aafb8b22f5712c493 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:23:22.436242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:22.482488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f772d9-9b3b-412f-9a58-0fc97f7d896c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:22.531884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015affca-fee3-42d8-bcbb-c9b21d2ca214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:22.532534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015affca-fee3-42d8-bcbb-c9b21d2ca214 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:22.532817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015affca-fee3-42d8-bcbb-c9b21d2ca214 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:22.533095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015affca-fee3-42d8-bcbb-c9b21d2ca214 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:22.546248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015affca-fee3-42d8-bcbb-c9b21d2ca214 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:22.547740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015affca-fee3-42d8-bcbb-c9b21d2ca214 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-015affca-fee3-42d8-bcbb-c9b21d2ca214 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:22.567295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:22.568320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:22.569813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 311/614] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Aug 4 02:23:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:22.578723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff7f71-79a0-407a-b681-0fed3faf48f7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:22.707903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff7f71-79a0-407a-b681-0fed3faf48f7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:22.744640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7bf0-3739-481c-ae32-6c26153fa64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:22.745262 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7bf0-3739-481c-ae32-6c26153fa64d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:22.745575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7bf0-3739-481c-ae32-6c26153fa64d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:22.745850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7bf0-3739-481c-ae32-6c26153fa64d None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:22.746648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7bf0-3739-481c-ae32-6c26153fa64d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:22.746962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7bf0-3739-481c-ae32-6c26153fa64d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:22.748408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7bf0-3739-481c-ae32-6c26153fa64d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:22.767712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 304/615] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Aug 4 02:23:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:22.773891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015affca-fee3-42d8-bcbb-c9b21d2ca214 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:22.911678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015affca-fee3-42d8-bcbb-c9b21d2ca214 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:22.932049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:22.957369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87601d98-2dbb-44b4-b08f-8c203684ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:22.958054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87601d98-2dbb-44b4-b08f-8c203684ffaf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:22.958278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87601d98-2dbb-44b4-b08f-8c203684ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:22.958609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87601d98-2dbb-44b4-b08f-8c203684ffaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.046251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87601d98-2dbb-44b4-b08f-8c203684ffaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:23.047698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87601d98-2dbb-44b4-b08f-8c203684ffaf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:23.106900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b744dc-3922-4d63-9906-34054311b996 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.107234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b744dc-3922-4d63-9906-34054311b996 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.107457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b744dc-3922-4d63-9906-34054311b996 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.109093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 305/616] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:23.113951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41b8be-d50a-42fe-9a4b-9fb7e0ac03f6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.114231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41b8be-d50a-42fe-9a4b-9fb7e0ac03f6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.114501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41b8be-d50a-42fe-9a4b-9fb7e0ac03f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.158384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2d41b8be-d50a-42fe-9a4b-9fb7e0ac03f6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:23.159609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2d41b8be-d50a-42fe-9a4b-9fb7e0ac03f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:23.163315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 312/617] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 02:23:23.171563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87601d98-2dbb-44b4-b08f-8c203684ffaf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:23.196210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:23.221806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:23.252642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 306/618] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:23.259725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93e2c0-f85b-4f62-95c3-ad99ff18ecd5 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.260016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93e2c0-f85b-4f62-95c3-ad99ff18ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.260294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93e2c0-f85b-4f62-95c3-ad99ff18ecd5 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.265750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 307/619] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:23.267004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba95b-b31b-4ac4-9a48-c868a71ef0e8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.267286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba95b-b31b-4ac4-9a48-c868a71ef0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.267560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba95b-b31b-4ac4-9a48-c868a71ef0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.297712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9c8ba95b-b31b-4ac4-9a48-c868a71ef0e8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:23.298911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9c8ba95b-b31b-4ac4-9a48-c868a71ef0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:23.321813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87601d98-2dbb-44b4-b08f-8c203684ffaf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:23.368513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11ea42-8cc1-472d-95e0-57424792cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:23.369912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11ea42-8cc1-472d-95e0-57424792cc19 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.370439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11ea42-8cc1-472d-95e0-57424792cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.370898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11ea42-8cc1-472d-95e0-57424792cc19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.377220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 308/620] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:23.378122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba95b-b31b-4ac4-9a48-c868a71ef0e8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:23.384299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11ea42-8cc1-472d-95e0-57424792cc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:23.385854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11ea42-8cc1-472d-95e0-57424792cc19 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-bd11ea42-8cc1-472d-95e0-57424792cc19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:23.407730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:23.408654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:23.409561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:23.409561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:23.409561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:23.409561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:23.416337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 313/621] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:23.416337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11ea42-8cc1-472d-95e0-57424792cc19 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:23.471441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:23.489865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba95b-b31b-4ac4-9a48-c868a71ef0e8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:23.519585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:23.529863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fae33-711c-460c-a268-df57e51b96cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:23.530503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fae33-711c-460c-a268-df57e51b96cf None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.530874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fae33-711c-460c-a268-df57e51b96cf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.531193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fae33-711c-460c-a268-df57e51b96cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.542881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fae33-711c-460c-a268-df57e51b96cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-488fae33-711c-460c-a268-df57e51b96cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:23.548169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:23.550273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:23.552214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:23.561364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11ea42-8cc1-472d-95e0-57424792cc19 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:23.561623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 309/622] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:23.561623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fae33-711c-460c-a268-df57e51b96cf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:23.608438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0d8ea-116e-4e04-b8af-80e0abf91ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:23.609272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0d8ea-116e-4e04-b8af-80e0abf91ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.609623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0d8ea-116e-4e04-b8af-80e0abf91ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.610166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0d8ea-116e-4e04-b8af-80e0abf91ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.610948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0d8ea-116e-4e04-b8af-80e0abf91ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:23.612124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0d8ea-116e-4e04-b8af-80e0abf91ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:23.613526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0d8ea-116e-4e04-b8af-80e0abf91ca9 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:23.630139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 314/623] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:23.631065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0d8ea-116e-4e04-b8af-80e0abf91ca9 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:23.684288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fae33-711c-460c-a268-df57e51b96cf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:23.723289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2de77-2b0b-4cb9-89e9-b76a01800197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:23.723923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2de77-2b0b-4cb9-89e9-b76a01800197 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.724204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2de77-2b0b-4cb9-89e9-b76a01800197 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.724478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2de77-2b0b-4cb9-89e9-b76a01800197 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.738895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2de77-2b0b-4cb9-89e9-b76a01800197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-07d2de77-2b0b-4cb9-89e9-b76a01800197 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:23.745421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:23.746320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:23.747149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 310/624] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:23.747844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2de77-2b0b-4cb9-89e9-b76a01800197 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:23.759875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:23.762155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0d8ea-116e-4e04-b8af-80e0abf91ca9 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:23.800927 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:23.809200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4804469-fed7-4905-8986-b6d8eff1a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:23.809856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4804469-fed7-4905-8986-b6d8eff1a87c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.810138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4804469-fed7-4905-8986-b6d8eff1a87c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.810414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4804469-fed7-4905-8986-b6d8eff1a87c None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.811259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4804469-fed7-4905-8986-b6d8eff1a87c None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:23.811562 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4804469-fed7-4905-8986-b6d8eff1a87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:23.813454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4804469-fed7-4905-8986-b6d8eff1a87c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:23.828892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 315/625] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:23.828892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4804469-fed7-4905-8986-b6d8eff1a87c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:23.884327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2de77-2b0b-4cb9-89e9-b76a01800197 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:23.922344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15313d-076a-45f5-bf9f-e9fa21974afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:23.922982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15313d-076a-45f5-bf9f-e9fa21974afc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.923260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15313d-076a-45f5-bf9f-e9fa21974afc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.923529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15313d-076a-45f5-bf9f-e9fa21974afc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.931062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15313d-076a-45f5-bf9f-e9fa21974afc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:23.932502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15313d-076a-45f5-bf9f-e9fa21974afc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:23.943076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4804469-fed7-4905-8986-b6d8eff1a87c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-bd15313d-076a-45f5-bf9f-e9fa21974afc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:23.944586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:23.945495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:23.946383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:23.946383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:23.946383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:23.946383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:23.946383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:23.946383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:23.946383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:23.946383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:23.946383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 311/626] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:23.947310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15313d-076a-45f5-bf9f-e9fa21974afc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:23.985937 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a1bc5-454f-4183-ab5e-c0a4b5d424e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:23.986559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a1bc5-454f-4183-ab5e-c0a4b5d424e2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:23.986843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a1bc5-454f-4183-ab5e-c0a4b5d424e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:23.987118 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a1bc5-454f-4183-ab5e-c0a4b5d424e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:23.987933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a1bc5-454f-4183-ab5e-c0a4b5d424e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:23.988244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a1bc5-454f-4183-ab5e-c0a4b5d424e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:23.989637 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a1bc5-454f-4183-ab5e-c0a4b5d424e2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:23.999735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 316/627] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:24.000591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a1bc5-454f-4183-ab5e-c0a4b5d424e2 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.016037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:24.052499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15313d-076a-45f5-bf9f-e9fa21974afc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.062667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:24.088321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8b54b-bf7c-4544-8e6f-057a70aab574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:24.089062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8b54b-bf7c-4544-8e6f-057a70aab574 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.089449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8b54b-bf7c-4544-8e6f-057a70aab574 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.089808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8b54b-bf7c-4544-8e6f-057a70aab574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.101100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8b54b-bf7c-4544-8e6f-057a70aab574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:24.102859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8b54b-bf7c-4544-8e6f-057a70aab574 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:24.112824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a1bc5-454f-4183-ab5e-c0a4b5d424e2 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-55c8b54b-bf7c-4544-8e6f-057a70aab574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:24.118730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:24.120739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:24.122918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:24.122918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:24.122918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:24.122918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:24.122918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 312/628] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:24.122918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8b54b-bf7c-4544-8e6f-057a70aab574 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.150265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6d01f-0df9-4371-bbe6-e77e2efd6811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:24.150891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6d01f-0df9-4371-bbe6-e77e2efd6811 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.151172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6d01f-0df9-4371-bbe6-e77e2efd6811 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.151447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6d01f-0df9-4371-bbe6-e77e2efd6811 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.152329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6d01f-0df9-4371-bbe6-e77e2efd6811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:24.152641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6d01f-0df9-4371-bbe6-e77e2efd6811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:24.154458 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6d01f-0df9-4371-bbe6-e77e2efd6811 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:24.172768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 317/629] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:24.173818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6d01f-0df9-4371-bbe6-e77e2efd6811 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.225568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8b54b-bf7c-4544-8e6f-057a70aab574 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.243546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:24.261682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afdeed-15fa-41c2-8a24-d96b520e37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:24.262345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afdeed-15fa-41c2-8a24-d96b520e37e2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.262764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afdeed-15fa-41c2-8a24-d96b520e37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.263108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afdeed-15fa-41c2-8a24-d96b520e37e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.275143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afdeed-15fa-41c2-8a24-d96b520e37e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:24.276755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afdeed-15fa-41c2-8a24-d96b520e37e2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:24.285911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6d01f-0df9-4371-bbe6-e77e2efd6811 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-43afdeed-15fa-41c2-8a24-d96b520e37e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:24.292465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:24.294230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:24.296265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:24.296265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:24.296265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:24.296265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:24.296265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 313/630] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:24.296265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afdeed-15fa-41c2-8a24-d96b520e37e2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.302093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:24.326332 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354018a3-7f68-4929-9efb-fd49ca3dd2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:24.327052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354018a3-7f68-4929-9efb-fd49ca3dd2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.327341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354018a3-7f68-4929-9efb-fd49ca3dd2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.327614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354018a3-7f68-4929-9efb-fd49ca3dd2c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.328307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354018a3-7f68-4929-9efb-fd49ca3dd2c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:24.328612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354018a3-7f68-4929-9efb-fd49ca3dd2c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:24.330203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354018a3-7f68-4929-9efb-fd49ca3dd2c5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:24.342559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 318/631] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:24.343397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354018a3-7f68-4929-9efb-fd49ca3dd2c5 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.407648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afdeed-15fa-41c2-8a24-d96b520e37e2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.443880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21755e2-631e-4178-ba5c-1ddba8a5e718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:24.444491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21755e2-631e-4178-ba5c-1ddba8a5e718 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.444767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21755e2-631e-4178-ba5c-1ddba8a5e718 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.445034 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21755e2-631e-4178-ba5c-1ddba8a5e718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.445854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21755e2-631e-4178-ba5c-1ddba8a5e718 None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=b0096da9bf564ceca61af67cac713f30) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:24.446165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21755e2-631e-4178-ba5c-1ddba8a5e718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:24.447858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21755e2-631e-4178-ba5c-1ddba8a5e718 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:24.450038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354018a3-7f68-4929-9efb-fd49ca3dd2c5 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.461573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 314/632] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:24 2022] GET /identity/v3/role_assignments?user.id=b0096da9bf564ceca61af67cac713f30&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:24.461573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21755e2-631e-4178-ba5c-1ddba8a5e718 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.499747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:24.505278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecb99b-4027-4c6b-9952-f6e38adf6851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:24.505968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecb99b-4027-4c6b-9952-f6e38adf6851 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.506246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecb99b-4027-4c6b-9952-f6e38adf6851 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.506518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecb99b-4027-4c6b-9952-f6e38adf6851 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.507221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecb99b-4027-4c6b-9952-f6e38adf6851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:24.507520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecb99b-4027-4c6b-9952-f6e38adf6851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:24.508929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecb99b-4027-4c6b-9952-f6e38adf6851 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:24.523856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 319/633] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:24.525210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc313c5-a7c1-4b5e-b589-de830b243345 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.525525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc313c5-a7c1-4b5e-b589-de830b243345 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.525801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc313c5-a7c1-4b5e-b589-de830b243345 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.527314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 320/634] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:24.536621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3190-962a-446b-98b5-2421df03c01b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.536955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3190-962a-446b-98b5-2421df03c01b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.537781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3190-962a-446b-98b5-2421df03c01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.559980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-db2a3190-962a-446b-98b5-2421df03c01b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:24.561274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-db2a3190-962a-446b-98b5-2421df03c01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:24.592622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:24.615616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21755e2-631e-4178-ba5c-1ddba8a5e718 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.647532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 321/635] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:24.648800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a3190-962a-446b-98b5-2421df03c01b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.658191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd587ab-356e-4539-9fe2-61ca01498668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:24.658828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd587ab-356e-4539-9fe2-61ca01498668 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.659106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd587ab-356e-4539-9fe2-61ca01498668 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.659375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd587ab-356e-4539-9fe2-61ca01498668 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.668131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd587ab-356e-4539-9fe2-61ca01498668 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:24.669741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd587ab-356e-4539-9fe2-61ca01498668 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7fd587ab-356e-4539-9fe2-61ca01498668 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:24.685722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:24.686752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:24.687702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 315/636] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:24.688291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd587ab-356e-4539-9fe2-61ca01498668 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.778087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a3190-962a-446b-98b5-2421df03c01b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.799969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:24.809664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd587ab-356e-4539-9fe2-61ca01498668 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.820611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40701288-d873-4762-a0bf-59248bbcaa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:24.821968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40701288-d873-4762-a0bf-59248bbcaa46 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.822761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40701288-d873-4762-a0bf-59248bbcaa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.823250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40701288-d873-4762-a0bf-59248bbcaa46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.832596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40701288-d873-4762-a0bf-59248bbcaa46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:24.835143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40701288-d873-4762-a0bf-59248bbcaa46 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:24.848084 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd4c9c-ff7f-4a45-b6d5-f13326b9331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:24.848828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd4c9c-ff7f-4a45-b6d5-f13326b9331b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:24.849180 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd4c9c-ff7f-4a45-b6d5-f13326b9331b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:24.850082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd4c9c-ff7f-4a45-b6d5-f13326b9331b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-40701288-d873-4762-a0bf-59248bbcaa46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:24.852159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:24.853067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:24.854041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:24.855308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 322/637] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:24.855414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40701288-d873-4762-a0bf-59248bbcaa46 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.864864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd4c9c-ff7f-4a45-b6d5-f13326b9331b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d1cd4c9c-ff7f-4a45-b6d5-f13326b9331b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:24.871972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:24.872893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:24.873813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 316/638] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:24.874520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd4c9c-ff7f-4a45-b6d5-f13326b9331b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:24.895453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:24.973061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40701288-d873-4762-a0bf-59248bbcaa46 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:24.987275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd4c9c-ff7f-4a45-b6d5-f13326b9331b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.009033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49edd95-e027-490d-aa25-ca4c54314533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.009702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49edd95-e027-490d-aa25-ca4c54314533 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.009983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49edd95-e027-490d-aa25-ca4c54314533 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.010257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49edd95-e027-490d-aa25-ca4c54314533 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.011045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49edd95-e027-490d-aa25-ca4c54314533 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:25.011355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49edd95-e027-490d-aa25-ca4c54314533 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.012783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49edd95-e027-490d-aa25-ca4c54314533 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.030089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850130-09f4-4df6-936d-efae8e32637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.030565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 323/639] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Aug 4 02:23:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:25.031045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850130-09f4-4df6-936d-efae8e32637a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.031448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850130-09f4-4df6-936d-efae8e32637a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.031792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df9818-6cde-451d-98cb-3d31b73e4ae5 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.031997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850130-09f4-4df6-936d-efae8e32637a None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.032092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df9818-6cde-451d-98cb-3d31b73e4ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.032334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df9818-6cde-451d-98cb-3d31b73e4ae5 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.033112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850130-09f4-4df6-936d-efae8e32637a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:25.033562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850130-09f4-4df6-936d-efae8e32637a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.038177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 324/640] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:25.038177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df9818-6cde-451d-98cb-3d31b73e4ae5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.038327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850130-09f4-4df6-936d-efae8e32637a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.056367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 317/641] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Aug 4 02:23:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:25.057505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850130-09f4-4df6-936d-efae8e32637a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.074179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:25.129168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:25.150217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df9818-6cde-451d-98cb-3d31b73e4ae5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.165788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850130-09f4-4df6-936d-efae8e32637a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.187868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389079f-42f9-467e-ab72-86b089b5149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.188588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389079f-42f9-467e-ab72-86b089b5149a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.188864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389079f-42f9-467e-ab72-86b089b5149a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.189135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389079f-42f9-467e-ab72-86b089b5149a None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.189865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389079f-42f9-467e-ab72-86b089b5149a None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:25.190163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389079f-42f9-467e-ab72-86b089b5149a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.191752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389079f-42f9-467e-ab72-86b089b5149a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.205502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 325/642] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:25.208119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95939a-28af-4732-90bf-539f629801fa None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.208576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95939a-28af-4732-90bf-539f629801fa None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.209004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95939a-28af-4732-90bf-539f629801fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.209756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb9952-2d32-4ffc-8154-4ed46ad55071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.210425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb9952-2d32-4ffc-8154-4ed46ad55071 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.210755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb9952-2d32-4ffc-8154-4ed46ad55071 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.211024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb9952-2d32-4ffc-8154-4ed46ad55071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.228542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-7a95939a-28af-4732-90bf-539f629801fa None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:25.229965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7a95939a-28af-4732-90bf-539f629801fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:25.281901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb9952-2d32-4ffc-8154-4ed46ad55071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.283273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb9952-2d32-4ffc-8154-4ed46ad55071 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.296972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:25.301243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 326/643] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:25.302118 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95939a-28af-4732-90bf-539f629801fa None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.381710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:25.404635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 318/644] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:25.404635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb9952-2d32-4ffc-8154-4ed46ad55071 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.414638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95939a-28af-4732-90bf-539f629801fa None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.451467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756edfe-f250-4d48-8490-68a25787e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.452462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756edfe-f250-4d48-8490-68a25787e73d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.452747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756edfe-f250-4d48-8490-68a25787e73d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.453019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756edfe-f250-4d48-8490-68a25787e73d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.463267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756edfe-f250-4d48-8490-68a25787e73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.464712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756edfe-f250-4d48-8490-68a25787e73d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-4756edfe-f250-4d48-8490-68a25787e73d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:25.479012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:25.479964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:25.480889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:25.480889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:25.480889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:25.480889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:25.480889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 327/645] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:25.481195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756edfe-f250-4d48-8490-68a25787e73d None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.508014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb9952-2d32-4ffc-8154-4ed46ad55071 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.521401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:25.546031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a14c-6cb9-4271-abb0-a43554d20f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.546593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a14c-6cb9-4271-abb0-a43554d20f8f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.546873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a14c-6cb9-4271-abb0-a43554d20f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.547249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a14c-6cb9-4271-abb0-a43554d20f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.557504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a14c-6cb9-4271-abb0-a43554d20f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.558959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a14c-6cb9-4271-abb0-a43554d20f8f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-2d52a14c-6cb9-4271-abb0-a43554d20f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:25.574450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:25.575346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:25.576360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:25.576360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:25.576360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:25.576360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:25.576360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 319/646] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:25.576360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a14c-6cb9-4271-abb0-a43554d20f8f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.605208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756edfe-f250-4d48-8490-68a25787e73d None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.632332 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:25.641881 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a32f9-1ce2-46f5-a1ce-f538e1a437eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.642618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a32f9-1ce2-46f5-a1ce-f538e1a437eb None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.643094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a32f9-1ce2-46f5-a1ce-f538e1a437eb None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.643457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a32f9-1ce2-46f5-a1ce-f538e1a437eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.655007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a32f9-1ce2-46f5-a1ce-f538e1a437eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-3a7a32f9-1ce2-46f5-a1ce-f538e1a437eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:25.660761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:25.661924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:25.662997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:25.664140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 328/647] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:25.664915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a32f9-1ce2-46f5-a1ce-f538e1a437eb None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.689124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a14c-6cb9-4271-abb0-a43554d20f8f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.727710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d3e6d-4678-4c02-954f-7d65ada1231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.728343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d3e6d-4678-4c02-954f-7d65ada1231e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.728617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d3e6d-4678-4c02-954f-7d65ada1231e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.728887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d3e6d-4678-4c02-954f-7d65ada1231e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.741966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d3e6d-4678-4c02-954f-7d65ada1231e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.743439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d3e6d-4678-4c02-954f-7d65ada1231e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4e0d3e6d-4678-4c02-954f-7d65ada1231e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:25.760060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:25.761164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:25.762081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:25.762081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:25.762081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:25.762081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:25.762081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 320/648] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:25.762081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d3e6d-4678-4c02-954f-7d65ada1231e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.780802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:25.781453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a32f9-1ce2-46f5-a1ce-f538e1a437eb None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.818602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d030687-3579-4f5e-8d00-f49b982a86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.819227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d030687-3579-4f5e-8d00-f49b982a86b8 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.819580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d030687-3579-4f5e-8d00-f49b982a86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.819959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d030687-3579-4f5e-8d00-f49b982a86b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.820766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d030687-3579-4f5e-8d00-f49b982a86b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:25.821157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d030687-3579-4f5e-8d00-f49b982a86b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.822649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d030687-3579-4f5e-8d00-f49b982a86b8 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.835657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 329/649] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:25.836635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d030687-3579-4f5e-8d00-f49b982a86b8 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.872372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d3e6d-4678-4c02-954f-7d65ada1231e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.886557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:25.907404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d2c8-5109-416f-b38a-d4afdb644fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.908013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d2c8-5109-416f-b38a-d4afdb644fdb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.908287 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d2c8-5109-416f-b38a-d4afdb644fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.908553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d2c8-5109-416f-b38a-d4afdb644fdb None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.909228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d2c8-5109-416f-b38a-d4afdb644fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:25.909553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d2c8-5109-416f-b38a-d4afdb644fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.911011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d2c8-5109-416f-b38a-d4afdb644fdb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.923192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 321/650] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:25.923809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d2c8-5109-416f-b38a-d4afdb644fdb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:25.948450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d030687-3579-4f5e-8d00-f49b982a86b8 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:25.985040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101fed4-3a39-4343-893b-3e21e848135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:25.985884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101fed4-3a39-4343-893b-3e21e848135d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:25.986239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101fed4-3a39-4343-893b-3e21e848135d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:25.986592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101fed4-3a39-4343-893b-3e21e848135d None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:25.987311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101fed4-3a39-4343-893b-3e21e848135d None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:25.987646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101fed4-3a39-4343-893b-3e21e848135d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:25.988973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101fed4-3a39-4343-893b-3e21e848135d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:25.998081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 330/651] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:25.998873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101fed4-3a39-4343-893b-3e21e848135d None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.011552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:26.036993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d2c8-5109-416f-b38a-d4afdb644fdb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.074468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2a733-b76f-4bd9-9e4e-b66272c5ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.075137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2a733-b76f-4bd9-9e4e-b66272c5ba6b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.075516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2a733-b76f-4bd9-9e4e-b66272c5ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.075898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2a733-b76f-4bd9-9e4e-b66272c5ba6b None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.076681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2a733-b76f-4bd9-9e4e-b66272c5ba6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:26.077077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2a733-b76f-4bd9-9e4e-b66272c5ba6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.078479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2a733-b76f-4bd9-9e4e-b66272c5ba6b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.090428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 322/652] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:26.091332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2a733-b76f-4bd9-9e4e-b66272c5ba6b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.113351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101fed4-3a39-4343-893b-3e21e848135d None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.124501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:26.157313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ab1e8-3c1a-4e96-9bcf-da2980c8494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.157981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ab1e8-3c1a-4e96-9bcf-da2980c8494f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.158257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ab1e8-3c1a-4e96-9bcf-da2980c8494f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.158527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ab1e8-3c1a-4e96-9bcf-da2980c8494f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.167348 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ab1e8-3c1a-4e96-9bcf-da2980c8494f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.169048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ab1e8-3c1a-4e96-9bcf-da2980c8494f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-fd2ab1e8-3c1a-4e96-9bcf-da2980c8494f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:26.183706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:26.184759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:26.185987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:26.185987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:26.185987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:26.185987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:26.185987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:26.185987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:26.185987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:26.185987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:26.189662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 331/653] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:26.190315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ab1e8-3c1a-4e96-9bcf-da2980c8494f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.207298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2a733-b76f-4bd9-9e4e-b66272c5ba6b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.242303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d5c51-da04-41c1-a1c8-b847989bdc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.243103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d5c51-da04-41c1-a1c8-b847989bdc29 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.243390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d5c51-da04-41c1-a1c8-b847989bdc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.243663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d5c51-da04-41c1-a1c8-b847989bdc29 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.248875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:26.254973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d5c51-da04-41c1-a1c8-b847989bdc29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.256870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d5c51-da04-41c1-a1c8-b847989bdc29 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-2a8d5c51-da04-41c1-a1c8-b847989bdc29 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:26.268399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:26.269576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:26.270530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 323/654] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:26.271142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d5c51-da04-41c1-a1c8-b847989bdc29 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.303162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ab1e8-3c1a-4e96-9bcf-da2980c8494f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.339174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ae7b5-cd9a-4887-9a86-97e1c96cdf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.340043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ae7b5-cd9a-4887-9a86-97e1c96cdf1e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.340477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ae7b5-cd9a-4887-9a86-97e1c96cdf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.340904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ae7b5-cd9a-4887-9a86-97e1c96cdf1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.352140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ae7b5-cd9a-4887-9a86-97e1c96cdf1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.354004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ae7b5-cd9a-4887-9a86-97e1c96cdf1e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-8d2ae7b5-cd9a-4887-9a86-97e1c96cdf1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:26.368746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:26.369810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:26.370678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:26.370678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:26.370678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:26.370678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:26.370678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 332/655] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:26.370678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ae7b5-cd9a-4887-9a86-97e1c96cdf1e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.377701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d5c51-da04-41c1-a1c8-b847989bdc29 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.397407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:26.413312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922d8a6-2d27-4b27-b1be-608264fc7216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.413981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922d8a6-2d27-4b27-b1be-608264fc7216 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.414261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922d8a6-2d27-4b27-b1be-608264fc7216 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.414536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922d8a6-2d27-4b27-b1be-608264fc7216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.421220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922d8a6-2d27-4b27-b1be-608264fc7216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.422692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922d8a6-2d27-4b27-b1be-608264fc7216 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d922d8a6-2d27-4b27-b1be-608264fc7216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:26.434164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:26.435024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:26.435904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:26.435904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:26.435904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:26.435904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:26.435904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:26.435904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:26.435904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:26.435904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:26.435904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 324/656] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:26.436376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922d8a6-2d27-4b27-b1be-608264fc7216 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.485832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ae7b5-cd9a-4887-9a86-97e1c96cdf1e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.492040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:26.522464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979e360-3e4e-4dd6-ac0a-7eb274e11375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.523188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979e360-3e4e-4dd6-ac0a-7eb274e11375 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.523480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979e360-3e4e-4dd6-ac0a-7eb274e11375 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.523749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979e360-3e4e-4dd6-ac0a-7eb274e11375 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.524492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979e360-3e4e-4dd6-ac0a-7eb274e11375 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:26.524798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979e360-3e4e-4dd6-ac0a-7eb274e11375 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.526257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979e360-3e4e-4dd6-ac0a-7eb274e11375 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.538602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 333/657] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:26.539397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979e360-3e4e-4dd6-ac0a-7eb274e11375 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.540694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922d8a6-2d27-4b27-b1be-608264fc7216 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.582416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b8ecb-8806-4b50-9e1d-eda892a5e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.583025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b8ecb-8806-4b50-9e1d-eda892a5e839 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.583299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b8ecb-8806-4b50-9e1d-eda892a5e839 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.583566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b8ecb-8806-4b50-9e1d-eda892a5e839 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.584913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b8ecb-8806-4b50-9e1d-eda892a5e839 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:26.585211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b8ecb-8806-4b50-9e1d-eda892a5e839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.586660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b8ecb-8806-4b50-9e1d-eda892a5e839 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.608545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 325/658] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Aug 4 02:23:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:26.608545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b8ecb-8806-4b50-9e1d-eda892a5e839 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.636524 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:26.657958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979e360-3e4e-4dd6-ac0a-7eb274e11375 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.691435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b0af2-8f33-41f5-ae40-b77b9f9eceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.692047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0af2-8f33-41f5-ae40-b77b9f9eceaa None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.692329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0af2-8f33-41f5-ae40-b77b9f9eceaa None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.692601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0af2-8f33-41f5-ae40-b77b9f9eceaa None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.693833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b0af2-8f33-41f5-ae40-b77b9f9eceaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:26.694136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b0af2-8f33-41f5-ae40-b77b9f9eceaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.695483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b0af2-8f33-41f5-ae40-b77b9f9eceaa None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.706889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 334/659] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:26.707653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b0af2-8f33-41f5-ae40-b77b9f9eceaa None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.715252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b8ecb-8806-4b50-9e1d-eda892a5e839 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.729077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:26.749136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ba98-eb71-47ce-bbf4-cde4e1e4da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.749764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ba98-eb71-47ce-bbf4-cde4e1e4da97 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.750072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ba98-eb71-47ce-bbf4-cde4e1e4da97 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.750308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ba98-eb71-47ce-bbf4-cde4e1e4da97 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.751035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793ba98-eb71-47ce-bbf4-cde4e1e4da97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:26.751335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793ba98-eb71-47ce-bbf4-cde4e1e4da97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.752738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793ba98-eb71-47ce-bbf4-cde4e1e4da97 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.764750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 326/660] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:26.765557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ba98-eb71-47ce-bbf4-cde4e1e4da97 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.811335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b0af2-8f33-41f5-ae40-b77b9f9eceaa None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.844066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a39a8-4cf6-49d1-ae68-91c96157f328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.844722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a39a8-4cf6-49d1-ae68-91c96157f328 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.845001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a39a8-4cf6-49d1-ae68-91c96157f328 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.845595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a39a8-4cf6-49d1-ae68-91c96157f328 None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/d7e996ea899e4bf8a65b721628a044ec/roles/a60b7cc5e9e5429aafb8b22f5712c493` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.855894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:26.860028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a39a8-4cf6-49d1-ae68-91c96157f328 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=d7e996ea899e4bf8a65b721628a044ec, role_id=a60b7cc5e9e5429aafb8b22f5712c493)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.861655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a39a8-4cf6-49d1-ae68-91c96157f328 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.863991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ba98-eb71-47ce-bbf4-cde4e1e4da97 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:26.874144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 335/661] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:23:26 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/d7e996ea899e4bf8a65b721628a044ec/roles/a60b7cc5e9e5429aafb8b22f5712c493 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:23:26.875341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce79f-ba3a-45a4-b69d-de2cb7fbf26b None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.875626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce79f-ba3a-45a4-b69d-de2cb7fbf26b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.875902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce79f-ba3a-45a4-b69d-de2cb7fbf26b None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.877363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 336/662] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:26.877967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce79f-ba3a-45a4-b69d-de2cb7fbf26b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:26.908250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e07304-23ba-456e-b2a8-a8b942efed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:26.908992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e07304-23ba-456e-b2a8-a8b942efed9f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:26.909354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e07304-23ba-456e-b2a8-a8b942efed9f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:26.909704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e07304-23ba-456e-b2a8-a8b942efed9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:26.959577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:26.990593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e07304-23ba-456e-b2a8-a8b942efed9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:26.992143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e07304-23ba-456e-b2a8-a8b942efed9f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:26.993260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce79f-ba3a-45a4-b69d-de2cb7fbf26b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:27.035165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af914-9bee-406f-b47c-6ac8c7848983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:27.035804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af914-9bee-406f-b47c-6ac8c7848983 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:27.036076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af914-9bee-406f-b47c-6ac8c7848983 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:27.036347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61af914-9bee-406f-b47c-6ac8c7848983 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:27.045386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61af914-9bee-406f-b47c-6ac8c7848983 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:27.046968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61af914-9bee-406f-b47c-6ac8c7848983 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d61af914-9bee-406f-b47c-6ac8c7848983 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:27.060292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:27.061520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 337/663] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:27.062952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af914-9bee-406f-b47c-6ac8c7848983 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:27.100677 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 327/664] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:27.102345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b747-b82c-45ec-b124-39d7e8520890 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:27.102861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b747-b82c-45ec-b124-39d7e8520890 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:27.103338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0b747-b82c-45ec-b124-39d7e8520890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:27.118447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:27.124405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a5c0b747-b82c-45ec-b124-39d7e8520890 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:27.125715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a5c0b747-b82c-45ec-b124-39d7e8520890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:27.174651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61af914-9bee-406f-b47c-6ac8c7848983 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:27.198628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 328/665] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:27.199764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0b747-b82c-45ec-b124-39d7e8520890 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:27.210518 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:27.214570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3d939-16f9-475f-ac2d-c111fee793cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:27.215374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3d939-16f9-475f-ac2d-c111fee793cf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:27.215865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3d939-16f9-475f-ac2d-c111fee793cf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:27.216717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3d939-16f9-475f-ac2d-c111fee793cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:27.217684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3d939-16f9-475f-ac2d-c111fee793cf None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=e7b8eac1856c4e7f86fe1dea9f752719) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:27.217996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3d939-16f9-475f-ac2d-c111fee793cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:27.219892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3d939-16f9-475f-ac2d-c111fee793cf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:27.233976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 338/666] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:27 2022] GET /identity/v3/role_assignments?user.id=e7b8eac1856c4e7f86fe1dea9f752719&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:27.235047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3d939-16f9-475f-ac2d-c111fee793cf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:27.344455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0b747-b82c-45ec-b124-39d7e8520890 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:27.382434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe89b69-76eb-44d5-8de7-cc82a89f56f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:27.383440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe89b69-76eb-44d5-8de7-cc82a89f56f5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:27.383996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe89b69-76eb-44d5-8de7-cc82a89f56f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:27.384468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe89b69-76eb-44d5-8de7-cc82a89f56f5 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:27.385437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe89b69-76eb-44d5-8de7-cc82a89f56f5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:27.385900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe89b69-76eb-44d5-8de7-cc82a89f56f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:27.387629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe89b69-76eb-44d5-8de7-cc82a89f56f5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:27.391968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3d939-16f9-475f-ac2d-c111fee793cf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:27.409057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:27.413486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 329/667] 10.222.0.69 () {56 vars in 1139 bytes} [Thu Aug 4 02:23:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:27.415087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe89b69-76eb-44d5-8de7-cc82a89f56f5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:27.439891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7a193-e83e-4fc7-9510-9257d77cbebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:27.440539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7a193-e83e-4fc7-9510-9257d77cbebf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:27.440821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7a193-e83e-4fc7-9510-9257d77cbebf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:27.441095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7a193-e83e-4fc7-9510-9257d77cbebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:27.452948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7a193-e83e-4fc7-9510-9257d77cbebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:27.454540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7a193-e83e-4fc7-9510-9257d77cbebf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-99d7a193-e83e-4fc7-9510-9257d77cbebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:27.470778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:27.471704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:27.473553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:27.473553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:27.473553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:27.473553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:27.473553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 339/668] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:27.473553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7a193-e83e-4fc7-9510-9257d77cbebf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:27.539256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe89b69-76eb-44d5-8de7-cc82a89f56f5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:27.541694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:27.579639 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742f0d-483e-4cb5-8fce-8013e9b5e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:27.580304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742f0d-483e-4cb5-8fce-8013e9b5e80f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:27.580682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742f0d-483e-4cb5-8fce-8013e9b5e80f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:27.581051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742f0d-483e-4cb5-8fce-8013e9b5e80f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:27.595361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742f0d-483e-4cb5-8fce-8013e9b5e80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:27.598798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7a193-e83e-4fc7-9510-9257d77cbebf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-15742f0d-483e-4cb5-8fce-8013e9b5e80f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:27.602844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:27.603941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:27.604985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:27.607099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 330/669] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:27.608051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742f0d-483e-4cb5-8fce-8013e9b5e80f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:27.658764 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902a9de-7705-437b-86d4-76a818717fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:27.659471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a9de-7705-437b-86d4-76a818717fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:27.659915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a9de-7705-437b-86d4-76a818717fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:27.660659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902a9de-7705-437b-86d4-76a818717fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:27.709288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:27.725541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742f0d-483e-4cb5-8fce-8013e9b5e80f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:27.750174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:27.758184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902a9de-7705-437b-86d4-76a818717fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:27.760611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902a9de-7705-437b-86d4-76a818717fd6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:27.764129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89538c8f-e25f-47f1-9e73-faa74670542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:27.765006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89538c8f-e25f-47f1-9e73-faa74670542f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:27.765513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89538c8f-e25f-47f1-9e73-faa74670542f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:27.765960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89538c8f-e25f-47f1-9e73-faa74670542f None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:27.766826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89538c8f-e25f-47f1-9e73-faa74670542f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:27.767299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89538c8f-e25f-47f1-9e73-faa74670542f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:27.768838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89538c8f-e25f-47f1-9e73-faa74670542f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:27.785704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 331/670] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:27.786787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89538c8f-e25f-47f1-9e73-faa74670542f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:27.872187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 340/671] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:27.873995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902a9de-7705-437b-86d4-76a818717fd6 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:27.917867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89538c8f-e25f-47f1-9e73-faa74670542f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:27.958533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811eb83-4b2c-4395-af0a-49ad84562645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:27.959202 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811eb83-4b2c-4395-af0a-49ad84562645 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:27.959476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811eb83-4b2c-4395-af0a-49ad84562645 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:27.959742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811eb83-4b2c-4395-af0a-49ad84562645 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:27.960446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811eb83-4b2c-4395-af0a-49ad84562645 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:27.960743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811eb83-4b2c-4395-af0a-49ad84562645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:27.962131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811eb83-4b2c-4395-af0a-49ad84562645 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:27.965589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:27.972102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 332/672] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:27.972566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811eb83-4b2c-4395-af0a-49ad84562645 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.010238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902a9de-7705-437b-86d4-76a818717fd6 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.027183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:28.051432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de469f6-75ce-4507-9947-eb405a02e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.052483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de469f6-75ce-4507-9947-eb405a02e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.053579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de469f6-75ce-4507-9947-eb405a02e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.054063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de469f6-75ce-4507-9947-eb405a02e2b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.061666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de469f6-75ce-4507-9947-eb405a02e2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.063482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de469f6-75ce-4507-9947-eb405a02e2b8 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-1de469f6-75ce-4507-9947-eb405a02e2b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:28.076243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:28.077429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:28.078526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:28.078526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:28.078526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:28.078526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:28.078526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:28.078526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:28.078526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:28.078526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:28.080683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 341/673] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:28.081877 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de469f6-75ce-4507-9947-eb405a02e2b8 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.085125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811eb83-4b2c-4395-af0a-49ad84562645 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.120654 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a371d-c886-4b2c-a27b-e2d13fb8eedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.121764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a371d-c886-4b2c-a27b-e2d13fb8eedd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.121764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a371d-c886-4b2c-a27b-e2d13fb8eedd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.121953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a371d-c886-4b2c-a27b-e2d13fb8eedd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.133089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a371d-c886-4b2c-a27b-e2d13fb8eedd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.134593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a371d-c886-4b2c-a27b-e2d13fb8eedd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-878a371d-c886-4b2c-a27b-e2d13fb8eedd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:28.149628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:28.150710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:28.151920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:28.151920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:28.151920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:28.151920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:28.151920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 333/674] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:28.151920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a371d-c886-4b2c-a27b-e2d13fb8eedd None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.196782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de469f6-75ce-4507-9947-eb405a02e2b8 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.225396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:28.234499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967192a-8cb4-4358-8853-66b855193590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.235472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967192a-8cb4-4358-8853-66b855193590 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.235894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967192a-8cb4-4358-8853-66b855193590 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.236330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967192a-8cb4-4358-8853-66b855193590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.248287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967192a-8cb4-4358-8853-66b855193590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.249572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:28.250853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967192a-8cb4-4358-8853-66b855193590 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.256303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a371d-c886-4b2c-a27b-e2d13fb8eedd None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-0967192a-8cb4-4358-8853-66b855193590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:28.268202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:28.269270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:28.270408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:28.270408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:28.270408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:28.270408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:28.272334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 342/675] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:28.273306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967192a-8cb4-4358-8853-66b855193590 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.297797 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73a44d-bd66-4197-8f5a-972b1970bfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.298329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73a44d-bd66-4197-8f5a-972b1970bfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.298705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73a44d-bd66-4197-8f5a-972b1970bfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.299076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73a44d-bd66-4197-8f5a-972b1970bfc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.299913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73a44d-bd66-4197-8f5a-972b1970bfc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:28.300315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73a44d-bd66-4197-8f5a-972b1970bfc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.301857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73a44d-bd66-4197-8f5a-972b1970bfc2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.314867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 334/676] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:28.315841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73a44d-bd66-4197-8f5a-972b1970bfc2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.385614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967192a-8cb4-4358-8853-66b855193590 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.421972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6488dd4-8318-43af-84ff-47528d3e2c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.423360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6488dd4-8318-43af-84ff-47528d3e2c35 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.423784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6488dd4-8318-43af-84ff-47528d3e2c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.424217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6488dd4-8318-43af-84ff-47528d3e2c35 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.425048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6488dd4-8318-43af-84ff-47528d3e2c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:28.425544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6488dd4-8318-43af-84ff-47528d3e2c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.425907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73a44d-bd66-4197-8f5a-972b1970bfc2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.427229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6488dd4-8318-43af-84ff-47528d3e2c35 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.441505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 343/677] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:28.442631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6488dd4-8318-43af-84ff-47528d3e2c35 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.464519 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0624c76-23da-4675-ad55-628bd893a034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.465171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0624c76-23da-4675-ad55-628bd893a034 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.465633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0624c76-23da-4675-ad55-628bd893a034 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.466187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0624c76-23da-4675-ad55-628bd893a034 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.466769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0624c76-23da-4675-ad55-628bd893a034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:28.467149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0624c76-23da-4675-ad55-628bd893a034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.468703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0624c76-23da-4675-ad55-628bd893a034 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.485773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 335/678] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:28.486429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0624c76-23da-4675-ad55-628bd893a034 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.491805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:28.507967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:28.560671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6488dd4-8318-43af-84ff-47528d3e2c35 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.603179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e05b6-0703-487f-9a98-5e6f8a7e34da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.603793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e05b6-0703-487f-9a98-5e6f8a7e34da None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.604070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e05b6-0703-487f-9a98-5e6f8a7e34da None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.604340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e05b6-0703-487f-9a98-5e6f8a7e34da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.605121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e05b6-0703-487f-9a98-5e6f8a7e34da None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=cc2ef9088a9941ddb4b163f282a1f7d1) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:28.605453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e05b6-0703-487f-9a98-5e6f8a7e34da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.606880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e05b6-0703-487f-9a98-5e6f8a7e34da None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.612766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0624c76-23da-4675-ad55-628bd893a034 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.613383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 344/679] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/role_assignments?user.id=cc2ef9088a9941ddb4b163f282a1f7d1&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:28.614304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e05b6-0703-487f-9a98-5e6f8a7e34da None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.653467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fa723-36d2-4fbb-936f-279d12d70b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.654798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fa723-36d2-4fbb-936f-279d12d70b84 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.655350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fa723-36d2-4fbb-936f-279d12d70b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.655856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fa723-36d2-4fbb-936f-279d12d70b84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.664317 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fa723-36d2-4fbb-936f-279d12d70b84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.666289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fa723-36d2-4fbb-936f-279d12d70b84 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f59fa723-36d2-4fbb-936f-279d12d70b84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:28.678993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:28.679939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:28.680855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:28.680855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:28.680855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:28.680855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:28.680855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:28.680855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:28.680855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:28.680855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:28.683473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 336/680] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:28.689467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fa723-36d2-4fbb-936f-279d12d70b84 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.724750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e05b6-0703-487f-9a98-5e6f8a7e34da None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.726270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:28.766689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b823b5-8ff1-41e9-bc50-c1707d5e3c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.767723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b823b5-8ff1-41e9-bc50-c1707d5e3c82 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.768212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b823b5-8ff1-41e9-bc50-c1707d5e3c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.768731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b823b5-8ff1-41e9-bc50-c1707d5e3c82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.784266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b823b5-8ff1-41e9-bc50-c1707d5e3c82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.789663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b823b5-8ff1-41e9-bc50-c1707d5e3c82 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d6b823b5-8ff1-41e9-bc50-c1707d5e3c82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:28.814758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:28.815847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:28.816777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 345/681] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:28.822392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b823b5-8ff1-41e9-bc50-c1707d5e3c82 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.845510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:28.874368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fa723-36d2-4fbb-936f-279d12d70b84 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.922323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4249-b276-44f3-8fba-f38fe728c64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.923083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4249-b276-44f3-8fba-f38fe728c64d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.923461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4249-b276-44f3-8fba-f38fe728c64d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.923835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4249-b276-44f3-8fba-f38fe728c64d None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.924648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4249-b276-44f3-8fba-f38fe728c64d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:28.925016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4249-b276-44f3-8fba-f38fe728c64d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.926540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4249-b276-44f3-8fba-f38fe728c64d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:28.940208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 337/682] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:28.946167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4249-b276-44f3-8fba-f38fe728c64d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:28.953501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b823b5-8ff1-41e9-bc50-c1707d5e3c82 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:28.995048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744c7ea-380c-45a5-8c2b-c527af9f5352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:28.995582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744c7ea-380c-45a5-8c2b-c527af9f5352 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:28.995857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744c7ea-380c-45a5-8c2b-c527af9f5352 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:28.996127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744c7ea-380c-45a5-8c2b-c527af9f5352 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:28.997067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744c7ea-380c-45a5-8c2b-c527af9f5352 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:28.997318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744c7ea-380c-45a5-8c2b-c527af9f5352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:28.998970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744c7ea-380c-45a5-8c2b-c527af9f5352 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:29.022110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 346/683] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:29.023793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744c7ea-380c-45a5-8c2b-c527af9f5352 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:29.047184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:29.064678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4249-b276-44f3-8fba-f38fe728c64d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:29.109114 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540ec47-50e5-43d6-82e5-85d1d065ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:29.109764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ec47-50e5-43d6-82e5-85d1d065ceac None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.110049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ec47-50e5-43d6-82e5-85d1d065ceac None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.110325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ec47-50e5-43d6-82e5-85d1d065ceac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.111114 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540ec47-50e5-43d6-82e5-85d1d065ceac None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=d110c27fc9c045ea9a4eb49b4dafe221) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:29.111421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540ec47-50e5-43d6-82e5-85d1d065ceac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:29.112883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540ec47-50e5-43d6-82e5-85d1d065ceac None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:29.117270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:29.122490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 338/684] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:28 2022] GET /identity/v3/role_assignments?user.id=d110c27fc9c045ea9a4eb49b4dafe221&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:29.123776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea8229-bb7b-479d-adf2-f166e9d6bbc7 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.125074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea8229-bb7b-479d-adf2-f166e9d6bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.125380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea8229-bb7b-479d-adf2-f166e9d6bbc7 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.127699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 339/685] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:29.133941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5fd96-6f6a-487e-9971-f88601ccc3fd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.134267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5fd96-6f6a-487e-9971-f88601ccc3fd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.134472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5fd96-6f6a-487e-9971-f88601ccc3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.149765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744c7ea-380c-45a5-8c2b-c527af9f5352 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:29.158585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-33d5fd96-6f6a-487e-9971-f88601ccc3fd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:29.159837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-33d5fd96-6f6a-487e-9971-f88601ccc3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:29.192581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d4acf-59da-49a6-8192-58eeec0e5d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:29.193779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d4acf-59da-49a6-8192-58eeec0e5d8a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.194064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d4acf-59da-49a6-8192-58eeec0e5d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.194337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d4acf-59da-49a6-8192-58eeec0e5d8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.238575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 340/686] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:29.272142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d4acf-59da-49a6-8192-58eeec0e5d8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:29.273554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d4acf-59da-49a6-8192-58eeec0e5d8a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:29.279283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5fd96-6f6a-487e-9971-f88601ccc3fd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:29.296142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:29.381374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 347/687] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 02:23:29.387101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d4acf-59da-49a6-8192-58eeec0e5d8a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:29.469756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5fd96-6f6a-487e-9971-f88601ccc3fd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:29.505903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d4acf-59da-49a6-8192-58eeec0e5d8a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:29.516181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:29.524603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebcece-2555-4ee7-9bea-202e23d669c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:29.525182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebcece-2555-4ee7-9bea-202e23d669c4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.525516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebcece-2555-4ee7-9bea-202e23d669c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.525791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebcece-2555-4ee7-9bea-202e23d669c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.529873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:29.539648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebcece-2555-4ee7-9bea-202e23d669c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f3ebcece-2555-4ee7-9bea-202e23d669c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:29.546648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:29.547581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:29.548432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:29.549560 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700396e-90ed-4815-9ae4-98cf9b6eec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:29.550152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700396e-90ed-4815-9ae4-98cf9b6eec44 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.550434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700396e-90ed-4815-9ae4-98cf9b6eec44 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.550704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700396e-90ed-4815-9ae4-98cf9b6eec44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.557129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 341/688] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:29.558480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00f219-dffe-4cee-89e8-9f7d266a3185 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.558770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00f219-dffe-4cee-89e8-9f7d266a3185 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.559049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00f219-dffe-4cee-89e8-9f7d266a3185 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.560491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 342/689] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:29.561049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00f219-dffe-4cee-89e8-9f7d266a3185 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:29.564972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700396e-90ed-4815-9ae4-98cf9b6eec44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:29.567755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700396e-90ed-4815-9ae4-98cf9b6eec44 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-9700396e-90ed-4815-9ae4-98cf9b6eec44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:29.589108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:29.590227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:29.591133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:29.591133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:29.591133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:29.591133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:29.591133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 348/690] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:29.592030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ddb4-0fd2-4d28-9be6-505a32ed039d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.592307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ddb4-0fd2-4d28-9be6-505a32ed039d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.592574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ddb4-0fd2-4d28-9be6-505a32ed039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.617240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-68c1ddb4-0fd2-4d28-9be6-505a32ed039d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:29.618898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-68c1ddb4-0fd2-4d28-9be6-505a32ed039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:29.704640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 349/691] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:29.704640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ddb4-0fd2-4d28-9be6-505a32ed039d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:29.706931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00f219-dffe-4cee-89e8-9f7d266a3185 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:29.766846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaab99-4856-4fcf-a2dc-f56900a96974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:29.767952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaab99-4856-4fcf-a2dc-f56900a96974 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.768380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaab99-4856-4fcf-a2dc-f56900a96974 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.769170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaab99-4856-4fcf-a2dc-f56900a96974 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.770080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaab99-4856-4fcf-a2dc-f56900a96974 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:29.770527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaab99-4856-4fcf-a2dc-f56900a96974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:29.773093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaab99-4856-4fcf-a2dc-f56900a96974 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:29.789917 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 343/692] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:29.791734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaab99-4856-4fcf-a2dc-f56900a96974 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:29.826963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ddb4-0fd2-4d28-9be6-505a32ed039d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:29.828741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:29.864830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:29.870957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294395b-df87-4ad6-a9cf-fc1071695ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:29.871702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294395b-df87-4ad6-a9cf-fc1071695ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.872121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294395b-df87-4ad6-a9cf-fc1071695ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.872852 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294395b-df87-4ad6-a9cf-fc1071695ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.873549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294395b-df87-4ad6-a9cf-fc1071695ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:29.873953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294395b-df87-4ad6-a9cf-fc1071695ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:29.875425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294395b-df87-4ad6-a9cf-fc1071695ca4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:29.887920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 350/693] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:29.888968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294395b-df87-4ad6-a9cf-fc1071695ca4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:29.925354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaab99-4856-4fcf-a2dc-f56900a96974 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:29.955664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc336a-36e4-4ce8-9ab5-4f9f58e7b39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:29.956440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc336a-36e4-4ce8-9ab5-4f9f58e7b39e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:29.956729 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc336a-36e4-4ce8-9ab5-4f9f58e7b39e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:29.957006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc336a-36e4-4ce8-9ab5-4f9f58e7b39e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:29.957659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc336a-36e4-4ce8-9ab5-4f9f58e7b39e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:29.959559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc336a-36e4-4ce8-9ab5-4f9f58e7b39e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9cdc336a-36e4-4ce8-9ab5-4f9f58e7b39e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:29.971578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:29.972751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:29.973806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 344/694] 10.222.0.69 () {56 vars in 1129 bytes} [Thu Aug 4 02:23:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:29.975657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc336a-36e4-4ce8-9ab5-4f9f58e7b39e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:29.999517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294395b-df87-4ad6-a9cf-fc1071695ca4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:30.034870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026d81b-c2b7-4883-bb1f-23a1afee607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:30.035636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d81b-c2b7-4883-bb1f-23a1afee607a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:30.035980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d81b-c2b7-4883-bb1f-23a1afee607a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:30.036323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d81b-c2b7-4883-bb1f-23a1afee607a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:30.048241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026d81b-c2b7-4883-bb1f-23a1afee607a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:30.049729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026d81b-c2b7-4883-bb1f-23a1afee607a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-1026d81b-c2b7-4883-bb1f-23a1afee607a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:30.065068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:30.066196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:30.067209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:30.067209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:30.067209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:30.067209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:30.069491 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 351/695] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:30.069491 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026d81b-c2b7-4883-bb1f-23a1afee607a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:30.087663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc336a-36e4-4ce8-9ab5-4f9f58e7b39e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:30.089003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:30.108592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:30.131207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d317c-548f-45d6-95c5-d36100b8a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:30.132203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d317c-548f-45d6-95c5-d36100b8a386 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:30.132694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d317c-548f-45d6-95c5-d36100b8a386 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:30.133148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d317c-548f-45d6-95c5-d36100b8a386 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:30.141203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d317c-548f-45d6-95c5-d36100b8a386 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:30.143109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d317c-548f-45d6-95c5-d36100b8a386 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c23d317c-548f-45d6-95c5-d36100b8a386 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:30.155834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:30.156777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:30.157694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:30.157694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:30.157694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:30.157694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:30.157694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:30.157694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:30.157694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:30.157694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:30.159889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 345/696] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:30.161036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d317c-548f-45d6-95c5-d36100b8a386 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:30.185918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026d81b-c2b7-4883-bb1f-23a1afee607a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:30.220569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff7876-fefb-4dda-af2c-9f2101dd9797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:30.221353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff7876-fefb-4dda-af2c-9f2101dd9797 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:30.221711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff7876-fefb-4dda-af2c-9f2101dd9797 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:30.222098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff7876-fefb-4dda-af2c-9f2101dd9797 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:30.222869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff7876-fefb-4dda-af2c-9f2101dd9797 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:30.223337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff7876-fefb-4dda-af2c-9f2101dd9797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:30.225425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff7876-fefb-4dda-af2c-9f2101dd9797 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:30.230290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 352/697] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Aug 4 02:23:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:30.231226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff7876-fefb-4dda-af2c-9f2101dd9797 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:30.274876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d317c-548f-45d6-95c5-d36100b8a386 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:30.312729 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc3b0d-f169-48e7-be51-5ee3b14584d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:30.313651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc3b0d-f169-48e7-be51-5ee3b14584d8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:30.314081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc3b0d-f169-48e7-be51-5ee3b14584d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:30.314538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc3b0d-f169-48e7-be51-5ee3b14584d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:30.314983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:30.316222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc3b0d-f169-48e7-be51-5ee3b14584d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:30.316726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc3b0d-f169-48e7-be51-5ee3b14584d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:30.318915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc3b0d-f169-48e7-be51-5ee3b14584d8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:30.333398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 346/698] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:30.335128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc3b0d-f169-48e7-be51-5ee3b14584d8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:30.339387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff7876-fefb-4dda-af2c-9f2101dd9797 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:30.373471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:30.373888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6c3e2-bb90-44b3-87cf-0db5c0730f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:30.375001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6c3e2-bb90-44b3-87cf-0db5c0730f37 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:30.375187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6c3e2-bb90-44b3-87cf-0db5c0730f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:30.375444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6c3e2-bb90-44b3-87cf-0db5c0730f37 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:30.376494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6c3e2-bb90-44b3-87cf-0db5c0730f37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:30.376810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6c3e2-bb90-44b3-87cf-0db5c0730f37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:30.378251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6c3e2-bb90-44b3-87cf-0db5c0730f37 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:30.391310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 353/699] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:30.392217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6c3e2-bb90-44b3-87cf-0db5c0730f37 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:30.449233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc3b0d-f169-48e7-be51-5ee3b14584d8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:30.489241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6eb79-f873-414a-ad49-1fc258747de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:30.490397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6eb79-f873-414a-ad49-1fc258747de8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:30.490951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6eb79-f873-414a-ad49-1fc258747de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:30.491423 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6eb79-f873-414a-ad49-1fc258747de8 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:30.492312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6eb79-f873-414a-ad49-1fc258747de8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:30.492914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6eb79-f873-414a-ad49-1fc258747de8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:30.494614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6eb79-f873-414a-ad49-1fc258747de8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:30.496502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6c3e2-bb90-44b3-87cf-0db5c0730f37 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:30.501508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 347/700] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Aug 4 02:23:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:30.502644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6eb79-f873-414a-ad49-1fc258747de8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:30.536278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6350f5-cb5d-484a-8597-eaef3b2ff798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:30.536926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6350f5-cb5d-484a-8597-eaef3b2ff798 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:30.537695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6350f5-cb5d-484a-8597-eaef3b2ff798 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:30.537990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6350f5-cb5d-484a-8597-eaef3b2ff798 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:30.545992 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6350f5-cb5d-484a-8597-eaef3b2ff798 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:30.547989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6350f5-cb5d-484a-8597-eaef3b2ff798 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:30.549592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-3b6350f5-cb5d-484a-8597-eaef3b2ff798 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:30.561611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:30.562617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:30.563737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 354/701] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:30.573779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6350f5-cb5d-484a-8597-eaef3b2ff798 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:30.634413 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:30.638570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6eb79-f873-414a-ad49-1fc258747de8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:30.678536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed769a-0977-4e75-a025-8619c8649f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:30.679414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed769a-0977-4e75-a025-8619c8649f42 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:30.679801 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed769a-0977-4e75-a025-8619c8649f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:30.680179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed769a-0977-4e75-a025-8619c8649f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:30.681091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed769a-0977-4e75-a025-8619c8649f42 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=b0096da9bf564ceca61af67cac713f30) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:30.681554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed769a-0977-4e75-a025-8619c8649f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:30.683210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed769a-0977-4e75-a025-8619c8649f42 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:30.690212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 348/702] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:30 2022] GET /identity/v3/role_assignments?user.id=b0096da9bf564ceca61af67cac713f30&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=999cac3070e64b82b981258349005963 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:30.779628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6350f5-cb5d-484a-8597-eaef3b2ff798 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:30.816349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd25ae0-b690-427b-8417-3e22327d79f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:30.816946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25ae0-b690-427b-8417-3e22327d79f5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:30.817227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25ae0-b690-427b-8417-3e22327d79f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:30.817543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25ae0-b690-427b-8417-3e22327d79f5 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:30.818924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd25ae0-b690-427b-8417-3e22327d79f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:30.819229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd25ae0-b690-427b-8417-3e22327d79f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:30.820683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd25ae0-b690-427b-8417-3e22327d79f5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:30.840549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 355/703] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Aug 4 02:23:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:30.846149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed769a-0977-4e75-a025-8619c8649f42 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:30.964778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed769a-0977-4e75-a025-8619c8649f42 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:31.011106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bb4f1-282b-489b-8d12-6872aaaf75de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:31.011867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bb4f1-282b-489b-8d12-6872aaaf75de None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.012216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bb4f1-282b-489b-8d12-6872aaaf75de None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.012551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bb4f1-282b-489b-8d12-6872aaaf75de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.057639 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:31.096700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bb4f1-282b-489b-8d12-6872aaaf75de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:31.098182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bb4f1-282b-489b-8d12-6872aaaf75de None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:31.118345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4cc26-de83-4788-8320-06700011909c None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.118788 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4cc26-de83-4788-8320-06700011909c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.119226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4cc26-de83-4788-8320-06700011909c None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.120933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 356/704] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:31.126135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e292c3-459c-4748-906c-4718a4098e8c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.126538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e292c3-459c-4748-906c-4718a4098e8c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.126918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e292c3-459c-4748-906c-4718a4098e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.146624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-54e292c3-459c-4748-906c-4718a4098e8c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:31.148061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-54e292c3-459c-4748-906c-4718a4098e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:31.231183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:31.237552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 349/705] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 02:23:31.244040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bb4f1-282b-489b-8d12-6872aaaf75de None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:31.258798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 357/706] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:31.295184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e292c3-459c-4748-906c-4718a4098e8c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:31.311354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:31.385497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bb4f1-282b-489b-8d12-6872aaaf75de None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:31.431839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e292c3-459c-4748-906c-4718a4098e8c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:31.446214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6f220-d820-45d4-bcf1-624150110994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:31.447110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f220-d820-45d4-bcf1-624150110994 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.447554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f220-d820-45d4-bcf1-624150110994 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.448042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f220-d820-45d4-bcf1-624150110994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.459532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6f220-d820-45d4-bcf1-624150110994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:31.461418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6f220-d820-45d4-bcf1-624150110994 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f2f6f220-d820-45d4-bcf1-624150110994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:31.477095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:31.478234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:31.479329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:31.479329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:31.479329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:31.479329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:31.481436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 350/707] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:31.487757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6f220-d820-45d4-bcf1-624150110994 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:31.500173 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3178fe-5e65-4d43-be58-cc9870ed1a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:31.501204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3178fe-5e65-4d43-be58-cc9870ed1a47 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.501698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3178fe-5e65-4d43-be58-cc9870ed1a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.502140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3178fe-5e65-4d43-be58-cc9870ed1a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.523246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3178fe-5e65-4d43-be58-cc9870ed1a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:31.524925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3178fe-5e65-4d43-be58-cc9870ed1a47 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-af3178fe-5e65-4d43-be58-cc9870ed1a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:31.547717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:31.549285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:31.550420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:31.550420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:31.550420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:31.550420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:31.553105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 358/708] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:31.558572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3178fe-5e65-4d43-be58-cc9870ed1a47 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:31.649765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:31.657043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6f220-d820-45d4-bcf1-624150110994 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:31.689748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3178fe-5e65-4d43-be58-cc9870ed1a47 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:31.694873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:31.722678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440673d4-0e63-47c2-8b09-12af42d3f260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:31.723301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440673d4-0e63-47c2-8b09-12af42d3f260 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.723582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440673d4-0e63-47c2-8b09-12af42d3f260 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.723855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440673d4-0e63-47c2-8b09-12af42d3f260 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.724687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440673d4-0e63-47c2-8b09-12af42d3f260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:31.724988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440673d4-0e63-47c2-8b09-12af42d3f260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:31.726513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440673d4-0e63-47c2-8b09-12af42d3f260 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:31.733794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2b69c-1fe1-40ac-9557-45693bfb025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:31.735070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b69c-1fe1-40ac-9557-45693bfb025c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.735496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b69c-1fe1-40ac-9557-45693bfb025c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.735909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b69c-1fe1-40ac-9557-45693bfb025c None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.737182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b69c-1fe1-40ac-9557-45693bfb025c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:31.737799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b69c-1fe1-40ac-9557-45693bfb025c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:31.739398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b69c-1fe1-40ac-9557-45693bfb025c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:31.744484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 351/709] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:31.745814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904ced5-faa8-41a1-ac55-01d3012a0cfa None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.746100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904ced5-faa8-41a1-ac55-01d3012a0cfa None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.746377 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904ced5-faa8-41a1-ac55-01d3012a0cfa None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.747893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 352/710] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:31.748435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904ced5-faa8-41a1-ac55-01d3012a0cfa None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:31.753587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 359/711] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:31.755086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b7b81-dd1c-493b-a12b-aa06deee5d8c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.756188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b7b81-dd1c-493b-a12b-aa06deee5d8c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.756672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b7b81-dd1c-493b-a12b-aa06deee5d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.780612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b21b7b81-dd1c-493b-a12b-aa06deee5d8c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:31.782260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b21b7b81-dd1c-493b-a12b-aa06deee5d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:31.869574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 360/712] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:31.870443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b7b81-dd1c-493b-a12b-aa06deee5d8c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:31.881719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904ced5-faa8-41a1-ac55-01d3012a0cfa None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:31.914745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:31.927366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a88a3-caa3-499a-8e33-dd644055c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:31.928284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a88a3-caa3-499a-8e33-dd644055c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:31.928741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a88a3-caa3-499a-8e33-dd644055c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:31.929185 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a88a3-caa3-499a-8e33-dd644055c7d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:31.936419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a88a3-caa3-499a-8e33-dd644055c7d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:31.938160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a88a3-caa3-499a-8e33-dd644055c7d5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-896a88a3-caa3-499a-8e33-dd644055c7d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:31.950561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:31.951541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:31.952562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:31.952562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:31.952562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:31.952562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:31.952562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:31.952562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:31.952562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:31.952562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:31.954953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 353/713] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:31.956064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a88a3-caa3-499a-8e33-dd644055c7d5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:31.998095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:32.012823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b7b81-dd1c-493b-a12b-aa06deee5d8c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:32.049097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991afd0-52d5-466b-a2f7-315eedc37e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:32.049799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991afd0-52d5-466b-a2f7-315eedc37e01 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:32.050090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991afd0-52d5-466b-a2f7-315eedc37e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:32.050370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991afd0-52d5-466b-a2f7-315eedc37e01 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:32.051155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991afd0-52d5-466b-a2f7-315eedc37e01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:32.053125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991afd0-52d5-466b-a2f7-315eedc37e01 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:32.066891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a88a3-caa3-499a-8e33-dd644055c7d5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:32.076316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 361/714] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:23:31 2022] POST /identity/v3/users => generated 254 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:32.077636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991afd0-52d5-466b-a2f7-315eedc37e01 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:32.104922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49479-8416-4826-802b-254d38fd3392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:32.105622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49479-8416-4826-802b-254d38fd3392 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:32.105922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49479-8416-4826-802b-254d38fd3392 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:32.106707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc49479-8416-4826-802b-254d38fd3392 None admin] PATH_INFO: `/v3/services/network` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:32.106828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc49479-8416-4826-802b-254d38fd3392 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:32.108288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc49479-8416-4826-802b-254d38fd3392 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-1fc49479-8416-4826-802b-254d38fd3392 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:32.117937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:32.119219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:23:32.120266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:32.124224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 354/715] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:31 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:32.125663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49479-8416-4826-802b-254d38fd3392 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:32.189742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:32.217861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991afd0-52d5-466b-a2f7-315eedc37e01 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:32.233818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:32.236634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc49479-8416-4826-802b-254d38fd3392 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:32.281382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729d99e-70aa-411c-8848-0eceab7a03af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:32.283330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729d99e-70aa-411c-8848-0eceab7a03af None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:32.283757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729d99e-70aa-411c-8848-0eceab7a03af None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:32.284254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729d99e-70aa-411c-8848-0eceab7a03af None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:32.288286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729d99e-70aa-411c-8848-0eceab7a03af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:32.293914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729d99e-70aa-411c-8848-0eceab7a03af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:32.297160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729d99e-70aa-411c-8848-0eceab7a03af None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:32.316264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b789a0-212c-4506-97af-22f0444e15c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:32.317041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b789a0-212c-4506-97af-22f0444e15c9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:32.317464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b789a0-212c-4506-97af-22f0444e15c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:32.317840 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b789a0-212c-4506-97af-22f0444e15c9 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:32.319284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b789a0-212c-4506-97af-22f0444e15c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:32.319685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b789a0-212c-4506-97af-22f0444e15c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:32.321184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b789a0-212c-4506-97af-22f0444e15c9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:32.321646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 362/716] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:32.323084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729d99e-70aa-411c-8848-0eceab7a03af None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:32.331333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 355/717] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:23:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:32.337613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b789a0-212c-4506-97af-22f0444e15c9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:32.457071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b789a0-212c-4506-97af-22f0444e15c9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:32.458223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729d99e-70aa-411c-8848-0eceab7a03af None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:32.495592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ae619-c5ab-4083-88f6-33df660bf2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:32.496206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ae619-c5ab-4083-88f6-33df660bf2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:32.496482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ae619-c5ab-4083-88f6-33df660bf2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:32.496752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ae619-c5ab-4083-88f6-33df660bf2c2 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:32.497463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ae619-c5ab-4083-88f6-33df660bf2c2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:32.497764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ae619-c5ab-4083-88f6-33df660bf2c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:32.499121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ae619-c5ab-4083-88f6-33df660bf2c2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:32.509576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 356/718] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:23:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:32.510667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50725a8-be4d-44f9-b79c-2d88ee57437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:32.511571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50725a8-be4d-44f9-b79c-2d88ee57437d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:32.512062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50725a8-be4d-44f9-b79c-2d88ee57437d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:32.512562 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50725a8-be4d-44f9-b79c-2d88ee57437d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:32.513661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50725a8-be4d-44f9-b79c-2d88ee57437d None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=d7e996ea899e4bf8a65b721628a044ec) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:32.514194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50725a8-be4d-44f9-b79c-2d88ee57437d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:32.515893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50725a8-be4d-44f9-b79c-2d88ee57437d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:32.524623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 363/719] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:32 2022] GET /identity/v3/role_assignments?user.id=d7e996ea899e4bf8a65b721628a044ec&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:32.984314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db2afd-32fe-4db1-8dbc-6cda3bc3cc21 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:32.984846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db2afd-32fe-4db1-8dbc-6cda3bc3cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:32.985148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db2afd-32fe-4db1-8dbc-6cda3bc3cc21 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:32.986854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 357/720] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:32.992362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13373ec-af9e-4289-96f2-85f6113a04a6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:32.992787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13373ec-af9e-4289-96f2-85f6113a04a6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:32.992987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13373ec-af9e-4289-96f2-85f6113a04a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:33.011497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-d13373ec-af9e-4289-96f2-85f6113a04a6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:33.012702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d13373ec-af9e-4289-96f2-85f6113a04a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:33.014702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:33.089007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 364/721] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:33.111815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db2afd-32fe-4db1-8dbc-6cda3bc3cc21 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:33.142463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:33.197163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31708845-3095-468c-b528-6040abd65c1f None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:33.197580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31708845-3095-468c-b528-6040abd65c1f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:33.197766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31708845-3095-468c-b528-6040abd65c1f None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:33.199891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 365/722] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:33.204803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea3c6-7bb0-4522-8b0a-759eb8295895 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:33.205107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea3c6-7bb0-4522-8b0a-759eb8295895 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:33.205400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ea3c6-7bb0-4522-8b0a-759eb8295895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:33.224809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b81ea3c6-7bb0-4522-8b0a-759eb8295895 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:33.226148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b81ea3c6-7bb0-4522-8b0a-759eb8295895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:33.234007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db2afd-32fe-4db1-8dbc-6cda3bc3cc21 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:33.303241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c9cc3-b597-4432-925f-8fb67d00ebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:33.304249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c9cc3-b597-4432-925f-8fb67d00ebf1 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:33.304972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c9cc3-b597-4432-925f-8fb67d00ebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:33.305644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c9cc3-b597-4432-925f-8fb67d00ebf1 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:33.307058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c9cc3-b597-4432-925f-8fb67d00ebf1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:33.309607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c9cc3-b597-4432-925f-8fb67d00ebf1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:33.344649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 358/723] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:23:33 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:33.359934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 366/724] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:33.394629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c9cc3-b597-4432-925f-8fb67d00ebf1 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:33.628660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:33.642469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c9cc3-b597-4432-925f-8fb67d00ebf1 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:33.682160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6ac0-1571-405f-9833-a752b8512793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:33.682810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6ac0-1571-405f-9833-a752b8512793 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:33.683081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6ac0-1571-405f-9833-a752b8512793 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:33.683349 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6ac0-1571-405f-9833-a752b8512793 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:33.701067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6ac0-1571-405f-9833-a752b8512793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-aa1b6ac0-1571-405f-9833-a752b8512793 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:33.706252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:33.707222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:33.708071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 359/725] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:33.713300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea3c6-7bb0-4522-8b0a-759eb8295895 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:33.798775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:33.853379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ea3c6-7bb0-4522-8b0a-759eb8295895 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:33.896798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df3f2-7b56-4987-8708-229e95678552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:33.897440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df3f2-7b56-4987-8708-229e95678552 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:33.897725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df3f2-7b56-4987-8708-229e95678552 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:33.897995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df3f2-7b56-4987-8708-229e95678552 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:33.898701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df3f2-7b56-4987-8708-229e95678552 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:33.898997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df3f2-7b56-4987-8708-229e95678552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:33.900344 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44df3f2-7b56-4987-8708-229e95678552 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:33.914041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 367/726] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:33.919217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6ac0-1571-405f-9833-a752b8512793 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:34.042480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6ac0-1571-405f-9833-a752b8512793 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:34.085962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349dc26-a2ee-4ef3-8213-ec5d175af1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:34.086908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349dc26-a2ee-4ef3-8213-ec5d175af1dd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:34.087407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349dc26-a2ee-4ef3-8213-ec5d175af1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:34.087888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349dc26-a2ee-4ef3-8213-ec5d175af1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:34.099619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349dc26-a2ee-4ef3-8213-ec5d175af1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:34.101474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349dc26-a2ee-4ef3-8213-ec5d175af1dd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:34.123350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0349dc26-a2ee-4ef3-8213-ec5d175af1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:34.130550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:34.131437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:34.132292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:34.132292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:34.132292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:34.132292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:34.134240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 360/727] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:34.140350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df3f2-7b56-4987-8708-229e95678552 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:34.285545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df3f2-7b56-4987-8708-229e95678552 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:34.327134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:34.338933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbba2a-c6d6-4e26-aa1b-02aa3454d90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:34.339556 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbba2a-c6d6-4e26-aa1b-02aa3454d90e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:34.340255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbba2a-c6d6-4e26-aa1b-02aa3454d90e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:34.340531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbba2a-c6d6-4e26-aa1b-02aa3454d90e None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:34.341224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbba2a-c6d6-4e26-aa1b-02aa3454d90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:34.341546 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbba2a-c6d6-4e26-aa1b-02aa3454d90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:34.342895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbba2a-c6d6-4e26-aa1b-02aa3454d90e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:34.361110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 368/728] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:34.367398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349dc26-a2ee-4ef3-8213-ec5d175af1dd None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:34.517688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349dc26-a2ee-4ef3-8213-ec5d175af1dd None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:34.563959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f321a0-7654-43f4-8885-86e6869f485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:34.564605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f321a0-7654-43f4-8885-86e6869f485e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:34.564885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f321a0-7654-43f4-8885-86e6869f485e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:34.565161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f321a0-7654-43f4-8885-86e6869f485e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:34.582493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f321a0-7654-43f4-8885-86e6869f485e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:34.584010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f321a0-7654-43f4-8885-86e6869f485e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-b3f321a0-7654-43f4-8885-86e6869f485e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:34.599949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:34.600877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:34.601848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 361/729] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Aug 4 02:23:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:34.606930 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbba2a-c6d6-4e26-aa1b-02aa3454d90e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:34.757102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbba2a-c6d6-4e26-aa1b-02aa3454d90e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:34.800613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7eba-40b7-4f1f-9e34-7ed3f962ddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:34.801162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7eba-40b7-4f1f-9e34-7ed3f962ddbc None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:34.801466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7eba-40b7-4f1f-9e34-7ed3f962ddbc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:34.801740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7eba-40b7-4f1f-9e34-7ed3f962ddbc None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:34.803326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7eba-40b7-4f1f-9e34-7ed3f962ddbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:34.803435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7eba-40b7-4f1f-9e34-7ed3f962ddbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:34.804807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7eba-40b7-4f1f-9e34-7ed3f962ddbc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:34.805313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43c24-4114-4b52-b6bd-9378a649cc1a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:34.805815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43c24-4114-4b52-b6bd-9378a649cc1a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:34.806298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43c24-4114-4b52-b6bd-9378a649cc1a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:34.808072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 362/730] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:34.812961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2994820-5f1d-4a16-8306-eafd02bc27bf None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:34.813492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2994820-5f1d-4a16-8306-eafd02bc27bf None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:34.813964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2994820-5f1d-4a16-8306-eafd02bc27bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:34.823495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 369/731] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Aug 4 02:23:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:34.828443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7eba-40b7-4f1f-9e34-7ed3f962ddbc None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:34.852278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a2994820-5f1d-4a16-8306-eafd02bc27bf None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:34.853514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a2994820-5f1d-4a16-8306-eafd02bc27bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:34.902399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:34.961236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:34.962246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7eba-40b7-4f1f-9e34-7ed3f962ddbc None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:34.981410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 363/732] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 02:23:34.982724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f5e8-b2a8-4249-88e0-19cfaaa4a125 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:34.983008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f5e8-b2a8-4249-88e0-19cfaaa4a125 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:34.983282 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9f5e8-b2a8-4249-88e0-19cfaaa4a125 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:34.986334 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 364/733] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:34.991698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3095e-69ad-4060-9fa0-0db3d25ce5ef None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:34.991990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3095e-69ad-4060-9fa0-0db3d25ce5ef None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:34.992271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3095e-69ad-4060-9fa0-0db3d25ce5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.015187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06785bcd-fa97-4bec-9733-7c5c2e854e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:35.015666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cff3095e-69ad-4060-9fa0-0db3d25ce5ef None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:35.015849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06785bcd-fa97-4bec-9733-7c5c2e854e74 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.016101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06785bcd-fa97-4bec-9733-7c5c2e854e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.016376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06785bcd-fa97-4bec-9733-7c5c2e854e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.016857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cff3095e-69ad-4060-9fa0-0db3d25ce5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:35.027952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06785bcd-fa97-4bec-9733-7c5c2e854e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:35.029787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06785bcd-fa97-4bec-9733-7c5c2e854e74 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-06785bcd-fa97-4bec-9733-7c5c2e854e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:35.046403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:35.047307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:35.048169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:35.048169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:35.048169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:35.048169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:35.048169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 370/734] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:35.048866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06785bcd-fa97-4bec-9733-7c5c2e854e74 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:35.094058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 365/735] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 02:23:35.102137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3095e-69ad-4060-9fa0-0db3d25ce5ef None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:35.150824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:35.157345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06785bcd-fa97-4bec-9733-7c5c2e854e74 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:35.194375 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6d3e5-fdda-4ad1-a1a5-84341bc192f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:35.195016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6d3e5-fdda-4ad1-a1a5-84341bc192f6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.195296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6d3e5-fdda-4ad1-a1a5-84341bc192f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.195569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6d3e5-fdda-4ad1-a1a5-84341bc192f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.206768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6d3e5-fdda-4ad1-a1a5-84341bc192f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-7dd6d3e5-fdda-4ad1-a1a5-84341bc192f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:35.213185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:35.215255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:35.217193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:35.225350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 371/736] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:35.225350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6d3e5-fdda-4ad1-a1a5-84341bc192f6 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:35.225710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3095e-69ad-4060-9fa0-0db3d25ce5ef None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:35.245777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:35.262379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ccf0-a94a-42b6-8fc8-1306f736c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:35.263179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ccf0-a94a-42b6-8fc8-1306f736c8ab None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.263527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ccf0-a94a-42b6-8fc8-1306f736c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.263883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ccf0-a94a-42b6-8fc8-1306f736c8ab None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.264722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ccf0-a94a-42b6-8fc8-1306f736c8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:35.265110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ccf0-a94a-42b6-8fc8-1306f736c8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:35.266676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ccf0-a94a-42b6-8fc8-1306f736c8ab None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:35.283999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 366/737] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:35.284962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ccf0-a94a-42b6-8fc8-1306f736c8ab None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:35.330908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6d3e5-fdda-4ad1-a1a5-84341bc192f6 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:35.367463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868a4ce-b71e-4f01-9137-05e4e323657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:35.368061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868a4ce-b71e-4f01-9137-05e4e323657c None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.368430 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868a4ce-b71e-4f01-9137-05e4e323657c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.368744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868a4ce-b71e-4f01-9137-05e4e323657c None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.369584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868a4ce-b71e-4f01-9137-05e4e323657c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:35.370943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868a4ce-b71e-4f01-9137-05e4e323657c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:35.390395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 372/738] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:23:35 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:35.390729 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ccf0-a94a-42b6-8fc8-1306f736c8ab None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:35.390873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868a4ce-b71e-4f01-9137-05e4e323657c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:35.439421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0676c1-0089-4f91-8be8-b1483da1d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:35.440299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0676c1-0089-4f91-8be8-b1483da1d693 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.440647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0676c1-0089-4f91-8be8-b1483da1d693 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.441018 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0676c1-0089-4f91-8be8-b1483da1d693 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.441988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0676c1-0089-4f91-8be8-b1483da1d693 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:35.442367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0676c1-0089-4f91-8be8-b1483da1d693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:35.444936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0676c1-0089-4f91-8be8-b1483da1d693 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:35.455638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 367/739] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:35.457261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc3ef7-6f34-4173-93fa-18169b4c33e4 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.457618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc3ef7-6f34-4173-93fa-18169b4c33e4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.457898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc3ef7-6f34-4173-93fa-18169b4c33e4 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.460193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 368/740] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:35.465945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479c334-574f-4422-9fa8-b09d23acedec None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.466449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479c334-574f-4422-9fa8-b09d23acedec None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.466848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479c334-574f-4422-9fa8-b09d23acedec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.488452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f479c334-574f-4422-9fa8-b09d23acedec None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:35.490126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f479c334-574f-4422-9fa8-b09d23acedec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:35.527198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:35.542252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:35.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 369/741] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:23:35.582939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479c334-574f-4422-9fa8-b09d23acedec None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:35.661714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868a4ce-b71e-4f01-9137-05e4e323657c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:35.698592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdee10-d59e-44ee-80da-d6aa46711ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:35.699247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdee10-d59e-44ee-80da-d6aa46711ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.699523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdee10-d59e-44ee-80da-d6aa46711ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.699793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdee10-d59e-44ee-80da-d6aa46711ef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.706656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdee10-d59e-44ee-80da-d6aa46711ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:35.708240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdee10-d59e-44ee-80da-d6aa46711ef3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:35.712115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479c334-574f-4422-9fa8-b09d23acedec None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-18fdee10-d59e-44ee-80da-d6aa46711ef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:35.723541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:35.724870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:35.726007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:35.726007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:35.726007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:35.726007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:35.726007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:35.726007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:35.726007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:35.726007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:35.726791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 373/742] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:35.727659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdee10-d59e-44ee-80da-d6aa46711ef3 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:35.769178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43ae11-fe4e-45d8-b76d-85d2503d0f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:35.769850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43ae11-fe4e-45d8-b76d-85d2503d0f53 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.770124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43ae11-fe4e-45d8-b76d-85d2503d0f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.770448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43ae11-fe4e-45d8-b76d-85d2503d0f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.784992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43ae11-fe4e-45d8-b76d-85d2503d0f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:35.786496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43ae11-fe4e-45d8-b76d-85d2503d0f53 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-bd43ae11-fe4e-45d8-b76d-85d2503d0f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:35.803516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:35.804460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:35.805406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:35.805406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:35.805406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:35.805406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:35.805406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 370/743] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:35.806267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43ae11-fe4e-45d8-b76d-85d2503d0f53 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:35.830656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:35.839657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:35.871718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdee10-d59e-44ee-80da-d6aa46711ef3 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:35.919299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e59e-3f08-4418-b2d0-df5bd246ae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:35.920960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e59e-3f08-4418-b2d0-df5bd246ae4b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.921485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e59e-3f08-4418-b2d0-df5bd246ae4b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.922244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e59e-3f08-4418-b2d0-df5bd246ae4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.930070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43ae11-fe4e-45d8-b76d-85d2503d0f53 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:35.937875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577e59e-3f08-4418-b2d0-df5bd246ae4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-b577e59e-3f08-4418-b2d0-df5bd246ae4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:35.946293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:35.947255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:35.948094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:35.951011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 374/744] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:35.952039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e59e-3f08-4418-b2d0-df5bd246ae4b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:35.975104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f87e1-6862-4379-b8ca-bc4f8f410e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:35.976655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f87e1-6862-4379-b8ca-bc4f8f410e0a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:35.977123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f87e1-6862-4379-b8ca-bc4f8f410e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:35.977628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f87e1-6862-4379-b8ca-bc4f8f410e0a None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:35.978533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f87e1-6862-4379-b8ca-bc4f8f410e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:35.979346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f87e1-6862-4379-b8ca-bc4f8f410e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:35.981562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f87e1-6862-4379-b8ca-bc4f8f410e0a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:36.003465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 371/745] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:36.005019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f87e1-6862-4379-b8ca-bc4f8f410e0a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:36.100802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:36.127017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f87e1-6862-4379-b8ca-bc4f8f410e0a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:36.145577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e59e-3f08-4418-b2d0-df5bd246ae4b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:36.171693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89066bd0-ad87-4a1f-89c6-6e19a60d50bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:36.172811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89066bd0-ad87-4a1f-89c6-6e19a60d50bc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.173242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89066bd0-ad87-4a1f-89c6-6e19a60d50bc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.173915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89066bd0-ad87-4a1f-89c6-6e19a60d50bc None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.175260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89066bd0-ad87-4a1f-89c6-6e19a60d50bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:36.175978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89066bd0-ad87-4a1f-89c6-6e19a60d50bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:36.178269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89066bd0-ad87-4a1f-89c6-6e19a60d50bc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:36.182752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e16a9-22f3-48c2-9e00-a900ed553f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:36.183496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e16a9-22f3-48c2-9e00-a900ed553f3e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.183911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e16a9-22f3-48c2-9e00-a900ed553f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.184409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e16a9-22f3-48c2-9e00-a900ed553f3e None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.189741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e16a9-22f3-48c2-9e00-a900ed553f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:36.189741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e16a9-22f3-48c2-9e00-a900ed553f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:36.189741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e16a9-22f3-48c2-9e00-a900ed553f3e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:36.191660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:36.200282 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 372/746] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:36.201184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89066bd0-ad87-4a1f-89c6-6e19a60d50bc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:36.210426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 375/747] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:36.211907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cedff-220e-4be7-91f8-bbba6a4aacbe None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.212282 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cedff-220e-4be7-91f8-bbba6a4aacbe None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.212627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cedff-220e-4be7-91f8-bbba6a4aacbe None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.218338 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 376/748] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:36.219209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cedff-220e-4be7-91f8-bbba6a4aacbe None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:36.336083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89066bd0-ad87-4a1f-89c6-6e19a60d50bc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:36.356584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cedff-220e-4be7-91f8-bbba6a4aacbe None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:36.375476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee38a6-003b-4f1b-a3ef-155490f47496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:36.376149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee38a6-003b-4f1b-a3ef-155490f47496 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.376465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee38a6-003b-4f1b-a3ef-155490f47496 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.376746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee38a6-003b-4f1b-a3ef-155490f47496 None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/b0096da9bf564ceca61af67cac713f30/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.379489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee38a6-003b-4f1b-a3ef-155490f47496 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=b0096da9bf564ceca61af67cac713f30, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:36.382226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee38a6-003b-4f1b-a3ef-155490f47496 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:36.404885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 373/749] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:23:36 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/b0096da9bf564ceca61af67cac713f30/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:23:36.406237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee38a6-003b-4f1b-a3ef-155490f47496 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:36.406689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c862f-d741-4216-9cf6-b137b779f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:36.407949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c862f-d741-4216-9cf6-b137b779f995 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.408459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c862f-d741-4216-9cf6-b137b779f995 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.409307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c862f-d741-4216-9cf6-b137b779f995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.411679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:36.422532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c862f-d741-4216-9cf6-b137b779f995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:36.425758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c862f-d741-4216-9cf6-b137b779f995 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d56c862f-d741-4216-9cf6-b137b779f995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:36.446840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:36.447952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:36.449070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:36.449070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:36.449070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:36.449070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:36.450895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 377/750] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:36.452540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec4282-edc1-4009-a3d4-14fbfd8056d9 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.452920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec4282-edc1-4009-a3d4-14fbfd8056d9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.453611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec4282-edc1-4009-a3d4-14fbfd8056d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.482432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-18ec4282-edc1-4009-a3d4-14fbfd8056d9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:36.486427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-18ec4282-edc1-4009-a3d4-14fbfd8056d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:36.549689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:36.554979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee38a6-003b-4f1b-a3ef-155490f47496 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:36.594431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 378/751] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:36.595746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec4282-edc1-4009-a3d4-14fbfd8056d9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:36.605390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de703-4c9d-4165-b492-b25eead1a8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:36.605390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de703-4c9d-4165-b492-b25eead1a8de None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.605390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de703-4c9d-4165-b492-b25eead1a8de None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.605390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de703-4c9d-4165-b492-b25eead1a8de None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.612859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44de703-4c9d-4165-b492-b25eead1a8de None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:36.614457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44de703-4c9d-4165-b492-b25eead1a8de None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c44de703-4c9d-4165-b492-b25eead1a8de None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:36.629734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:36.631567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:36.632722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 374/752] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:23:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:36.637604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de703-4c9d-4165-b492-b25eead1a8de None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:36.705905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:36.736587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec4282-edc1-4009-a3d4-14fbfd8056d9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:36.750431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de703-4c9d-4165-b492-b25eead1a8de None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:36.783558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44800bd3-cee9-48c2-808f-aa29bb8b5d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:36.784288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44800bd3-cee9-48c2-808f-aa29bb8b5d6a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.784722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44800bd3-cee9-48c2-808f-aa29bb8b5d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.785071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44800bd3-cee9-48c2-808f-aa29bb8b5d6a None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.785953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44800bd3-cee9-48c2-808f-aa29bb8b5d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:36.786346 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44800bd3-cee9-48c2-808f-aa29bb8b5d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:36.788616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44800bd3-cee9-48c2-808f-aa29bb8b5d6a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:36.791049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c671534-fc9e-42da-8f28-d6c09e683432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:36.791692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c671534-fc9e-42da-8f28-d6c09e683432 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.791975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c671534-fc9e-42da-8f28-d6c09e683432 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.792304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c671534-fc9e-42da-8f28-d6c09e683432 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.792938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c671534-fc9e-42da-8f28-d6c09e683432 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:36.794331 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c671534-fc9e-42da-8f28-d6c09e683432 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:36.801710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 379/753] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:36.802672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44800bd3-cee9-48c2-808f-aa29bb8b5d6a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-3c671534-fc9e-42da-8f28-d6c09e683432 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:36.808037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:36.808958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:36.809832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 375/754] 10.222.0.69 () {56 vars in 1129 bytes} [Thu Aug 4 02:23:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:36.810679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c671534-fc9e-42da-8f28-d6c09e683432 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:36.861660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:36.928043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44800bd3-cee9-48c2-808f-aa29bb8b5d6a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:36.945964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c671534-fc9e-42da-8f28-d6c09e683432 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:36.972903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:36.978668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a390c89-c84d-4979-b09d-d5e403b59baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:36.979581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a390c89-c84d-4979-b09d-d5e403b59baf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.979868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a390c89-c84d-4979-b09d-d5e403b59baf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.980147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a390c89-c84d-4979-b09d-d5e403b59baf None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.980951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a390c89-c84d-4979-b09d-d5e403b59baf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:36.981259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a390c89-c84d-4979-b09d-d5e403b59baf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:36.982720 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a390c89-c84d-4979-b09d-d5e403b59baf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:36.983667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da087c-d153-4462-b8cc-57f172e2d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:36.984394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da087c-d153-4462-b8cc-57f172e2d433 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:36.984780 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da087c-d153-4462-b8cc-57f172e2d433 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:36.985146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da087c-d153-4462-b8cc-57f172e2d433 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:36.993727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da087c-d153-4462-b8cc-57f172e2d433 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:36.995322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da087c-d153-4462-b8cc-57f172e2d433 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-45da087c-d153-4462-b8cc-57f172e2d433 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:37.007198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:37.008806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:37.010967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:37.012278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 380/755] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Aug 4 02:23:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:37.012278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a390c89-c84d-4979-b09d-d5e403b59baf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:37.012559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 376/756] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:37.012559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da087c-d153-4462-b8cc-57f172e2d433 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:37.126410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da087c-d153-4462-b8cc-57f172e2d433 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:37.138322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:37.144481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a390c89-c84d-4979-b09d-d5e403b59baf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:37.175675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1336db2-104d-4f58-b0e7-13c3edb6fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:37.176529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1336db2-104d-4f58-b0e7-13c3edb6fab2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.177788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1336db2-104d-4f58-b0e7-13c3edb6fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.178074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1336db2-104d-4f58-b0e7-13c3edb6fab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.182461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161d156-2942-435b-8970-82778c72c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:37.183193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d156-2942-435b-8970-82778c72c73c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.183726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d156-2942-435b-8970-82778c72c73c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.183891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d156-2942-435b-8970-82778c72c73c None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.184660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161d156-2942-435b-8970-82778c72c73c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:37.185054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161d156-2942-435b-8970-82778c72c73c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:37.186638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161d156-2942-435b-8970-82778c72c73c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:37.196403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 381/757] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Aug 4 02:23:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:37.197461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161d156-2942-435b-8970-82778c72c73c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:37.251911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:37.271717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1336db2-104d-4f58-b0e7-13c3edb6fab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:37.273474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1336db2-104d-4f58-b0e7-13c3edb6fab2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:37.305283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161d156-2942-435b-8970-82778c72c73c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:37.344485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9e56f-d54a-4e97-9017-ece29ae4abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:37.345244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9e56f-d54a-4e97-9017-ece29ae4abbb None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.345636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9e56f-d54a-4e97-9017-ece29ae4abbb None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.346003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9e56f-d54a-4e97-9017-ece29ae4abbb None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.346879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9e56f-d54a-4e97-9017-ece29ae4abbb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:37.347277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9e56f-d54a-4e97-9017-ece29ae4abbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:37.348764 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9e56f-d54a-4e97-9017-ece29ae4abbb None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:37.368666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 382/758] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Aug 4 02:23:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:37.369726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9e56f-d54a-4e97-9017-ece29ae4abbb None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:37.389589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:37.407762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 377/759] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:23:37.408999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1336db2-104d-4f58-b0e7-13c3edb6fab2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:37.480626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9e56f-d54a-4e97-9017-ece29ae4abbb None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:37.517083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:37.528149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c2ea1-58ff-4ede-9c66-d635ee546cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:37.529264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c2ea1-58ff-4ede-9c66-d635ee546cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.529576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c2ea1-58ff-4ede-9c66-d635ee546cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.529854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c2ea1-58ff-4ede-9c66-d635ee546cb4 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.530952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c2ea1-58ff-4ede-9c66-d635ee546cb4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:37.531266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c2ea1-58ff-4ede-9c66-d635ee546cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:37.532887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c2ea1-58ff-4ede-9c66-d635ee546cb4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:37.537025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1336db2-104d-4f58-b0e7-13c3edb6fab2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:37.541978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 383/760] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Aug 4 02:23:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:37.543107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c2ea1-58ff-4ede-9c66-d635ee546cb4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:37.589056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb72cd-0688-4958-8115-91a60212a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:37.589715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb72cd-0688-4958-8115-91a60212a786 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.589993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb72cd-0688-4958-8115-91a60212a786 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.590267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb72cd-0688-4958-8115-91a60212a786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.643994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:37.664884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c2ea1-58ff-4ede-9c66-d635ee546cb4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:37.674522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb72cd-0688-4958-8115-91a60212a786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:37.676296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb72cd-0688-4958-8115-91a60212a786 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:37.701445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ed45-1a67-46a9-964f-bda720f8118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:37.702308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ed45-1a67-46a9-964f-bda720f8118a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.702585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ed45-1a67-46a9-964f-bda720f8118a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.702851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ed45-1a67-46a9-964f-bda720f8118a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.713967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017ed45-1a67-46a9-964f-bda720f8118a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:37.716147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017ed45-1a67-46a9-964f-bda720f8118a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-0017ed45-1a67-46a9-964f-bda720f8118a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:37.733786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:37.734709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:37.735607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:37.735607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:37.735607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:37.735607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:37.739637 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 384/761] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:37.740749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ed45-1a67-46a9-964f-bda720f8118a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:37.774605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:37.791726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 378/762] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:23:37.797269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc74966-2cc1-45fa-a4ff-67dc2d852c29 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.797576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc74966-2cc1-45fa-a4ff-67dc2d852c29 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.797856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc74966-2cc1-45fa-a4ff-67dc2d852c29 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.799273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 379/763] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:37.799805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc74966-2cc1-45fa-a4ff-67dc2d852c29 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:37.855287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ed45-1a67-46a9-964f-bda720f8118a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:37.891571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83292df-a575-4620-8e01-9ab14540fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:37.892228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83292df-a575-4620-8e01-9ab14540fef1 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.892463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83292df-a575-4620-8e01-9ab14540fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.892739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83292df-a575-4620-8e01-9ab14540fef1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.893511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83292df-a575-4620-8e01-9ab14540fef1 None admin] RBAC: Adding query filter params (interface=public, service_id=80acbdf4584e4b5dbb9c45bf4d360463, region_id=RegionOne) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:37.893818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83292df-a575-4620-8e01-9ab14540fef1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:37.895174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83292df-a575-4620-8e01-9ab14540fef1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:37.897565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:37.904228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 385/764] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Aug 4 02:23:37 2022] GET /identity/v3/endpoints?service_id=80acbdf4584e4b5dbb9c45bf4d360463&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:37.905607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83292df-a575-4620-8e01-9ab14540fef1 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:37.911389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc74966-2cc1-45fa-a4ff-67dc2d852c29 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:37.947366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741636-4ef9-4a32-8f95-0d758deb0866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:37.947967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741636-4ef9-4a32-8f95-0d758deb0866 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.948240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741636-4ef9-4a32-8f95-0d758deb0866 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.948506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741636-4ef9-4a32-8f95-0d758deb0866 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.949182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741636-4ef9-4a32-8f95-0d758deb0866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:37.949521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741636-4ef9-4a32-8f95-0d758deb0866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:37.950897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741636-4ef9-4a32-8f95-0d758deb0866 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:37.963287 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 380/765] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:37.964291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863de02f-3e8a-4165-9d34-ead801b5a474 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:37.964569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863de02f-3e8a-4165-9d34-ead801b5a474 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:37.964838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863de02f-3e8a-4165-9d34-ead801b5a474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:37.982204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-863de02f-3e8a-4165-9d34-ead801b5a474 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:37.983372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-863de02f-3e8a-4165-9d34-ead801b5a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:38.016842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83292df-a575-4620-8e01-9ab14540fef1 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.029088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:38.051942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb3297-a130-4891-8eed-bf3e14efcba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.053110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb3297-a130-4891-8eed-bf3e14efcba3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.053410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb3297-a130-4891-8eed-bf3e14efcba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.053679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb3297-a130-4891-8eed-bf3e14efcba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.061371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 381/766] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:38.061371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863de02f-3e8a-4165-9d34-ead801b5a474 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.070192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb3297-a130-4891-8eed-bf3e14efcba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.071764 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb3297-a130-4891-8eed-bf3e14efcba3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-fadb3297-a130-4891-8eed-bf3e14efcba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:38.087503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:38.088570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:38.089505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:38.089505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:38.089505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:38.089505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:38.089505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 386/767] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:38.089505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb3297-a130-4891-8eed-bf3e14efcba3 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.138918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:38.176915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863de02f-3e8a-4165-9d34-ead801b5a474 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.195564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb3297-a130-4891-8eed-bf3e14efcba3 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.210757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0dc7-7513-4a04-94af-1a180ef898aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.211364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0dc7-7513-4a04-94af-1a180ef898aa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.211638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0dc7-7513-4a04-94af-1a180ef898aa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.211908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0dc7-7513-4a04-94af-1a180ef898aa None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.212555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b0dc7-7513-4a04-94af-1a180ef898aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.213992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b0dc7-7513-4a04-94af-1a180ef898aa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.219100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 382/768] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:38.219866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0dc7-7513-4a04-94af-1a180ef898aa None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.244500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e5191-e9a4-4874-a5ae-79b33c422237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.245576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e5191-e9a4-4874-a5ae-79b33c422237 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.246069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e5191-e9a4-4874-a5ae-79b33c422237 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.246405 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e5191-e9a4-4874-a5ae-79b33c422237 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.254939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e5191-e9a4-4874-a5ae-79b33c422237 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.257310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e5191-e9a4-4874-a5ae-79b33c422237 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-ce7e5191-e9a4-4874-a5ae-79b33c422237 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:38.272000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:38.273134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:38.274048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:38.274048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:38.274048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:38.274048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:38.274048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:38.274048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:38.274048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:38.274048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:38.274489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 387/769] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:38.275314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e5191-e9a4-4874-a5ae-79b33c422237 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.282324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:38.366091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0dc7-7513-4a04-94af-1a180ef898aa None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.395190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e5191-e9a4-4874-a5ae-79b33c422237 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.406824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596998dd-ee76-4fce-a781-0ca65cd30a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.407010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:38.407393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596998dd-ee76-4fce-a781-0ca65cd30a24 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.407712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596998dd-ee76-4fce-a781-0ca65cd30a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.408073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596998dd-ee76-4fce-a781-0ca65cd30a24 None admin] PATH_INFO: `/v3/services/network` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.408979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596998dd-ee76-4fce-a781-0ca65cd30a24 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.410412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596998dd-ee76-4fce-a781-0ca65cd30a24 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-596998dd-ee76-4fce-a781-0ca65cd30a24 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:38.423122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:38.424134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:38.424958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 383/770] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:38.425777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596998dd-ee76-4fce-a781-0ca65cd30a24 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.437131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483ce70-6844-4ff8-8c20-83b5ab912b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.437808 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483ce70-6844-4ff8-8c20-83b5ab912b2b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.438085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483ce70-6844-4ff8-8c20-83b5ab912b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.438353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483ce70-6844-4ff8-8c20-83b5ab912b2b None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.439152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483ce70-6844-4ff8-8c20-83b5ab912b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:38.439446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483ce70-6844-4ff8-8c20-83b5ab912b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.440908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483ce70-6844-4ff8-8c20-83b5ab912b2b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.456641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 388/771] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:38.457625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483ce70-6844-4ff8-8c20-83b5ab912b2b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.554533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596998dd-ee76-4fce-a781-0ca65cd30a24 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.557716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:38.584674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483ce70-6844-4ff8-8c20-83b5ab912b2b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.592266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1281f28-f56c-405c-8461-1fabf9632962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.592958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1281f28-f56c-405c-8461-1fabf9632962 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.593308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1281f28-f56c-405c-8461-1fabf9632962 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.593677 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1281f28-f56c-405c-8461-1fabf9632962 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.594496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1281f28-f56c-405c-8461-1fabf9632962 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:38.594805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1281f28-f56c-405c-8461-1fabf9632962 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.596238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1281f28-f56c-405c-8461-1fabf9632962 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.609389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 384/772] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:38.610448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1281f28-f56c-405c-8461-1fabf9632962 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.627049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaac6c-cb69-4e71-96c9-fc764f47d8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.627709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaac6c-cb69-4e71-96c9-fc764f47d8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.627993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaac6c-cb69-4e71-96c9-fc764f47d8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.628316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaac6c-cb69-4e71-96c9-fc764f47d8a3 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.629107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaac6c-cb69-4e71-96c9-fc764f47d8a3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:38.629446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaac6c-cb69-4e71-96c9-fc764f47d8a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.631423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaac6c-cb69-4e71-96c9-fc764f47d8a3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.641282 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 389/773] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:38.642571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57bd12-cc65-4875-8982-164d70557202 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.642855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57bd12-cc65-4875-8982-164d70557202 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.643128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57bd12-cc65-4875-8982-164d70557202 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.649089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 390/774] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:38.649089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57bd12-cc65-4875-8982-164d70557202 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.684041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:38.720474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1281f28-f56c-405c-8461-1fabf9632962 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.752962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57bd12-cc65-4875-8982-164d70557202 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.760611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b9cd-c5c1-47b2-bf89-f11e144da629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.761250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b9cd-c5c1-47b2-bf89-f11e144da629 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.761817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b9cd-c5c1-47b2-bf89-f11e144da629 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.761925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07b9cd-c5c1-47b2-bf89-f11e144da629 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.768762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07b9cd-c5c1-47b2-bf89-f11e144da629 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.770191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07b9cd-c5c1-47b2-bf89-f11e144da629 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ca07b9cd-c5c1-47b2-bf89-f11e144da629 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:38.781694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:38.782587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:38.783475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:38.783475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:38.783475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:38.783475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:38.783475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:38.783475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:38.783475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:38.783475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:38.783475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 385/775] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:38.783951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b9cd-c5c1-47b2-bf89-f11e144da629 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.794989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f28e0-aa7a-42f7-a2af-b0421051c6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.795619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f28e0-aa7a-42f7-a2af-b0421051c6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.795888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f28e0-aa7a-42f7-a2af-b0421051c6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.796164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f28e0-aa7a-42f7-a2af-b0421051c6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.796955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f28e0-aa7a-42f7-a2af-b0421051c6a7 None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=758a5ce9caf046929eec499e6afc1dd8) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:38.797260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f28e0-aa7a-42f7-a2af-b0421051c6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.798707 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f28e0-aa7a-42f7-a2af-b0421051c6a7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.805428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 391/776] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/role_assignments?user.id=758a5ce9caf046929eec499e6afc1dd8&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:38.806398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff7712-8887-4228-a4a4-df8d9079c097 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.806683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff7712-8887-4228-a4a4-df8d9079c097 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.806958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff7712-8887-4228-a4a4-df8d9079c097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.818249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:38.830698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4cff7712-8887-4228-a4a4-df8d9079c097 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:38.831959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4cff7712-8887-4228-a4a4-df8d9079c097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:38.925155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07b9cd-c5c1-47b2-bf89-f11e144da629 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:38.925381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 392/777] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:38.926157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff7712-8887-4228-a4a4-df8d9079c097 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:38.971020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:38.972031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db265d53-dfbb-4143-b781-3ce060fc9d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:38.972723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db265d53-dfbb-4143-b781-3ce060fc9d5a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:38.973076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db265d53-dfbb-4143-b781-3ce060fc9d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:38.973485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db265d53-dfbb-4143-b781-3ce060fc9d5a None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:38.974478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db265d53-dfbb-4143-b781-3ce060fc9d5a None admin] RBAC: Adding query filter params (type=network) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:38.974869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db265d53-dfbb-4143-b781-3ce060fc9d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:38.976414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db265d53-dfbb-4143-b781-3ce060fc9d5a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:38.983296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 386/778] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:38.983966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db265d53-dfbb-4143-b781-3ce060fc9d5a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:39.056250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff7712-8887-4228-a4a4-df8d9079c097 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:39.079629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:39.092187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db265d53-dfbb-4143-b781-3ce060fc9d5a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:39.096634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ea230-7a78-4170-b299-167d5577645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:39.097243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea230-7a78-4170-b299-167d5577645c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:39.097557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea230-7a78-4170-b299-167d5577645c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:39.097827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea230-7a78-4170-b299-167d5577645c None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:39.098570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ea230-7a78-4170-b299-167d5577645c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:39.099383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ea230-7a78-4170-b299-167d5577645c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:39.100891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ea230-7a78-4170-b299-167d5577645c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:39.114619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 393/779] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:39.115933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ea230-7a78-4170-b299-167d5577645c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:39.134768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e197cd-f5fd-416c-9920-5c8a80ddac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:39.135413 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e197cd-f5fd-416c-9920-5c8a80ddac9f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:39.135695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e197cd-f5fd-416c-9920-5c8a80ddac9f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:39.135974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e197cd-f5fd-416c-9920-5c8a80ddac9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:39.146762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e197cd-f5fd-416c-9920-5c8a80ddac9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d7e197cd-f5fd-416c-9920-5c8a80ddac9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:39.151691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:39.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 387/780] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:39.154767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e197cd-f5fd-416c-9920-5c8a80ddac9f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:39.218082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:39.233299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ea230-7a78-4170-b299-167d5577645c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:39.258598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e197cd-f5fd-416c-9920-5c8a80ddac9f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:39.273948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f314c5-67c9-49da-824a-968967ec3e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:39.274960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f314c5-67c9-49da-824a-968967ec3e9e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:39.275404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f314c5-67c9-49da-824a-968967ec3e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:39.275819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f314c5-67c9-49da-824a-968967ec3e9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:39.276708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f314c5-67c9-49da-824a-968967ec3e9e None admin] RBAC: Adding query filter params (interface=public, service_id=ba38d7a82d4e4a8d8df49fefa5d8ebba, region_id=RegionOne) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:39.277259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f314c5-67c9-49da-824a-968967ec3e9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:39.279127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f314c5-67c9-49da-824a-968967ec3e9e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:39.284869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 394/781] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Aug 4 02:23:39 2022] GET /identity/v3/endpoints?service_id=ba38d7a82d4e4a8d8df49fefa5d8ebba&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:39.285970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f314c5-67c9-49da-824a-968967ec3e9e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:39.308487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b509a20-d097-4c52-92d8-67cef49cc8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:39.309189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b509a20-d097-4c52-92d8-67cef49cc8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:39.309995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b509a20-d097-4c52-92d8-67cef49cc8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:39.310361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b509a20-d097-4c52-92d8-67cef49cc8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:39.311255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b509a20-d097-4c52-92d8-67cef49cc8e8 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=d7e996ea899e4bf8a65b721628a044ec) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:39.311681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b509a20-d097-4c52-92d8-67cef49cc8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:39.313206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b509a20-d097-4c52-92d8-67cef49cc8e8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:39.325852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 388/782] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:39 2022] GET /identity/v3/role_assignments?user.id=d7e996ea899e4bf8a65b721628a044ec&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=999cac3070e64b82b981258349005963 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:39.325852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b509a20-d097-4c52-92d8-67cef49cc8e8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:39.340999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:39.485506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b509a20-d097-4c52-92d8-67cef49cc8e8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:39.488781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f314c5-67c9-49da-824a-968967ec3e9e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:39.523102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ca355-f577-4b68-a122-1b5f2f9b14d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:39.523736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ca355-f577-4b68-a122-1b5f2f9b14d6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:39.523993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ca355-f577-4b68-a122-1b5f2f9b14d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:39.524327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ca355-f577-4b68-a122-1b5f2f9b14d6 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:39.524926 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ca355-f577-4b68-a122-1b5f2f9b14d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:39.526307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ca355-f577-4b68-a122-1b5f2f9b14d6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:39.529073 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452fe4a-a5cb-4011-bc3f-afcbc2d5255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:39.529875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452fe4a-a5cb-4011-bc3f-afcbc2d5255f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:39.530434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452fe4a-a5cb-4011-bc3f-afcbc2d5255f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:39.530845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452fe4a-a5cb-4011-bc3f-afcbc2d5255f None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:39.531699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452fe4a-a5cb-4011-bc3f-afcbc2d5255f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:39.532182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 389/783] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Aug 4 02:23:39 2022] GET /identity/v3/services => generated 772 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:39.532329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452fe4a-a5cb-4011-bc3f-afcbc2d5255f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:39.533838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452fe4a-a5cb-4011-bc3f-afcbc2d5255f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:39.545105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 395/784] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:39.552515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ca355-f577-4b68-a122-1b5f2f9b14d6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:39.641302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:39.678055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ca355-f577-4b68-a122-1b5f2f9b14d6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:39.721163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1768d1-5db5-4b8e-99b0-9d9abf7aa1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:39.721835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1768d1-5db5-4b8e-99b0-9d9abf7aa1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:39.722118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1768d1-5db5-4b8e-99b0-9d9abf7aa1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:39.722393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1768d1-5db5-4b8e-99b0-9d9abf7aa1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:39.736876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1768d1-5db5-4b8e-99b0-9d9abf7aa1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:39.738433 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1768d1-5db5-4b8e-99b0-9d9abf7aa1f2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-be1768d1-5db5-4b8e-99b0-9d9abf7aa1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:39.754320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:39.755893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:39.757175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:39.757175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:39.757175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:39.757175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:39.757175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 390/785] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:39.762133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452fe4a-a5cb-4011-bc3f-afcbc2d5255f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:39.782640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:39.871506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452fe4a-a5cb-4011-bc3f-afcbc2d5255f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:39.912990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7ed9d-eeaa-4af4-81fd-93e7a6daae5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:39.913637 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7ed9d-eeaa-4af4-81fd-93e7a6daae5c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:39.913919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7ed9d-eeaa-4af4-81fd-93e7a6daae5c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:39.914195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7ed9d-eeaa-4af4-81fd-93e7a6daae5c None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:39.914894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7ed9d-eeaa-4af4-81fd-93e7a6daae5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:39.915196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7ed9d-eeaa-4af4-81fd-93e7a6daae5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:39.916559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7ed9d-eeaa-4af4-81fd-93e7a6daae5c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:39.935128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 396/786] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:39.940810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1768d1-5db5-4b8e-99b0-9d9abf7aa1f2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:40.068400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1768d1-5db5-4b8e-99b0-9d9abf7aa1f2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:40.103983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:40.114773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78d86-a70d-41fe-8a69-9797d2999ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:40.115502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78d86-a70d-41fe-8a69-9797d2999ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:40.116225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78d86-a70d-41fe-8a69-9797d2999ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:40.116889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78d86-a70d-41fe-8a69-9797d2999ab3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:40.131031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a78d86-a70d-41fe-8a69-9797d2999ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:40.132419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a78d86-a70d-41fe-8a69-9797d2999ab3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a8a78d86-a70d-41fe-8a69-9797d2999ab3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:40.148359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:40.149417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:40.150787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 391/787] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Aug 4 02:23:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:40.156099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7ed9d-eeaa-4af4-81fd-93e7a6daae5c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:40.267428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:40.300087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7ed9d-eeaa-4af4-81fd-93e7a6daae5c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:40.346178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a974501-bc88-49ef-873a-88caa1bb4a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:40.346797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a974501-bc88-49ef-873a-88caa1bb4a05 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:40.347084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a974501-bc88-49ef-873a-88caa1bb4a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:40.347354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a974501-bc88-49ef-873a-88caa1bb4a05 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:40.348153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a974501-bc88-49ef-873a-88caa1bb4a05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:40.348460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a974501-bc88-49ef-873a-88caa1bb4a05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:40.349969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a974501-bc88-49ef-873a-88caa1bb4a05 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:40.374817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 397/788] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Aug 4 02:23:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:40.381095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78d86-a70d-41fe-8a69-9797d2999ab3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:40.387538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc42eef-f36f-44c2-9e92-53134b89b8a5 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:40.388097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc42eef-f36f-44c2-9e92-53134b89b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:40.388591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc42eef-f36f-44c2-9e92-53134b89b8a5 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:40.390508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 398/789] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:40.395948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6679dbc-74c5-460c-9a9f-6c2fc4294da8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:40.396463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6679dbc-74c5-460c-9a9f-6c2fc4294da8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:40.397024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6679dbc-74c5-460c-9a9f-6c2fc4294da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:40.425322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-a6679dbc-74c5-460c-9a9f-6c2fc4294da8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:40.426532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a6679dbc-74c5-460c-9a9f-6c2fc4294da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:40.546764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78d86-a70d-41fe-8a69-9797d2999ab3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:40.551690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 399/790] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:23:40.594768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6679dbc-74c5-460c-9a9f-6c2fc4294da8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:40.627338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aee084-ab83-4987-ac9c-fb67181d1916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:40.628331 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aee084-ab83-4987-ac9c-fb67181d1916 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:40.628812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aee084-ab83-4987-ac9c-fb67181d1916 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:40.629284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aee084-ab83-4987-ac9c-fb67181d1916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:40.698824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:40.700791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:40.718159 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aee084-ab83-4987-ac9c-fb67181d1916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:40.719935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aee084-ab83-4987-ac9c-fb67181d1916 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:40.770694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6679dbc-74c5-460c-9a9f-6c2fc4294da8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:40.828002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d89c67-ca33-421c-b45e-ee73d32251f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:40.830318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d89c67-ca33-421c-b45e-ee73d32251f4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:40.830616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d89c67-ca33-421c-b45e-ee73d32251f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:40.830908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d89c67-ca33-421c-b45e-ee73d32251f4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:40.831532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d89c67-ca33-421c-b45e-ee73d32251f4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:40.832899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d89c67-ca33-421c-b45e-ee73d32251f4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-81d89c67-ca33-421c-b45e-ee73d32251f4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:40.854600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:40.855615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 02:23:40.856444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:40.857842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 400/791] 10.222.0.69 () {56 vars in 1129 bytes} [Thu Aug 4 02:23:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:40.863769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d89c67-ca33-421c-b45e-ee73d32251f4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:40.878169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 392/792] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:23:40.883686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aee084-ab83-4987-ac9c-fb67181d1916 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:41.033010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:41.044138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d89c67-ca33-421c-b45e-ee73d32251f4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:41.050406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aee084-ab83-4987-ac9c-fb67181d1916 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:41.085755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c525-b48e-4ac7-a572-6aca31d58679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:41.086405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c525-b48e-4ac7-a572-6aca31d58679 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.086686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c525-b48e-4ac7-a572-6aca31d58679 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.086962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216c525-b48e-4ac7-a572-6aca31d58679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.093678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:41.097728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216c525-b48e-4ac7-a572-6aca31d58679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:41.100288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216c525-b48e-4ac7-a572-6aca31d58679 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:41.114022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb69a-ee79-45c4-a120-267ae8076dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:41.114683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb69a-ee79-45c4-a120-267ae8076dcd None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.114965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb69a-ee79-45c4-a120-267ae8076dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.115236 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bb69a-ee79-45c4-a120-267ae8076dcd None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.115922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb69a-ee79-45c4-a120-267ae8076dcd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:41.116226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb69a-ee79-45c4-a120-267ae8076dcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d216c525-b48e-4ac7-a572-6aca31d58679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:41.116841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:41.117714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:41.118783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:41.118783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:41.118783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:41.118783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:41.119418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bb69a-ee79-45c4-a120-267ae8076dcd None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:41.119500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 393/793] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:41.122710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 401/794] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Aug 4 02:23:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:41.123400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c525-b48e-4ac7-a572-6aca31d58679 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:41.128274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb69a-ee79-45c4-a120-267ae8076dcd None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:41.308230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216c525-b48e-4ac7-a572-6aca31d58679 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:41.346909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e6706-933f-4a00-ac45-99c96c8b20fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:41.347544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e6706-933f-4a00-ac45-99c96c8b20fd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.347830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e6706-933f-4a00-ac45-99c96c8b20fd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.348107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e6706-933f-4a00-ac45-99c96c8b20fd None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.349631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e6706-933f-4a00-ac45-99c96c8b20fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:41.349954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e6706-933f-4a00-ac45-99c96c8b20fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:41.351334 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e6706-933f-4a00-ac45-99c96c8b20fd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:41.361664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:41.365660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bb69a-ee79-45c4-a120-267ae8076dcd None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:41.366160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 394/795] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:41.367191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5970c88-754d-4809-a86b-3add02ac85c1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.367870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5970c88-754d-4809-a86b-3add02ac85c1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.368412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5970c88-754d-4809-a86b-3add02ac85c1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.374218 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 395/796] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:41.375007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5970c88-754d-4809-a86b-3add02ac85c1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:41.414406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a363f6-ff2d-42d6-82ab-2b83e7a39e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:41.415395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a363f6-ff2d-42d6-82ab-2b83e7a39e9c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.415884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a363f6-ff2d-42d6-82ab-2b83e7a39e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.416363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a363f6-ff2d-42d6-82ab-2b83e7a39e9c None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.417239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a363f6-ff2d-42d6-82ab-2b83e7a39e9c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:41.417792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a363f6-ff2d-42d6-82ab-2b83e7a39e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:41.419880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a363f6-ff2d-42d6-82ab-2b83e7a39e9c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:41.428318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 402/797] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Aug 4 02:23:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:41.429738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb15fd-a648-4ab9-8e74-99c9cea4cdf5 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.430248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb15fd-a648-4ab9-8e74-99c9cea4cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.430749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb15fd-a648-4ab9-8e74-99c9cea4cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.453751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-14cb15fd-a648-4ab9-8e74-99c9cea4cdf5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:41.455722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-14cb15fd-a648-4ab9-8e74-99c9cea4cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:41.488224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5970c88-754d-4809-a86b-3add02ac85c1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:41.515708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:41.524938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf7d6e-85a8-46ab-91b1-d4f91fe6489e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:41.525635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf7d6e-85a8-46ab-91b1-d4f91fe6489e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.525915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf7d6e-85a8-46ab-91b1-d4f91fe6489e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.526257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf7d6e-85a8-46ab-91b1-d4f91fe6489e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.533686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf7d6e-85a8-46ab-91b1-d4f91fe6489e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:41.535465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf7d6e-85a8-46ab-91b1-d4f91fe6489e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:41.538168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 403/798] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:41.539189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb15fd-a648-4ab9-8e74-99c9cea4cdf5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-cbdf7d6e-85a8-46ab-91b1-d4f91fe6489e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:41.562295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:41.563223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:41.564171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:41.564171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:41.564171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:41.564171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:41.564171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:41.564171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:41.564171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:41.564171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:41.564171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 396/799] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:41.569175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf7d6e-85a8-46ab-91b1-d4f91fe6489e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:41.637951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:41.654302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb15fd-a648-4ab9-8e74-99c9cea4cdf5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:41.684015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf7d6e-85a8-46ab-91b1-d4f91fe6489e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:41.693598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60112e-4328-44e6-b316-cb3b91ee88a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:41.694636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60112e-4328-44e6-b316-cb3b91ee88a3 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.695146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60112e-4328-44e6-b316-cb3b91ee88a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.695724 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60112e-4328-44e6-b316-cb3b91ee88a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.696706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60112e-4328-44e6-b316-cb3b91ee88a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:41.698393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60112e-4328-44e6-b316-cb3b91ee88a3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:41.721896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ad396-4ff7-4883-9317-7cb1694b3bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:41.722606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ad396-4ff7-4883-9317-7cb1694b3bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.722937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ad396-4ff7-4883-9317-7cb1694b3bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.723228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ad396-4ff7-4883-9317-7cb1694b3bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.724027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ad396-4ff7-4883-9317-7cb1694b3bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:41.724336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ad396-4ff7-4883-9317-7cb1694b3bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:41.724929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 404/800] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:23:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:41.725781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60112e-4328-44e6-b316-cb3b91ee88a3 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:41.725957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ad396-4ff7-4883-9317-7cb1694b3bc8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:41.741994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 397/801] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:41.743664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2975d15-f9c9-4658-982d-17b9f7eff739 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.743956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2975d15-f9c9-4658-982d-17b9f7eff739 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.744234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2975d15-f9c9-4658-982d-17b9f7eff739 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.746166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 398/802] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:41.747361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2975d15-f9c9-4658-982d-17b9f7eff739 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:41.784434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:41.862526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60112e-4328-44e6-b316-cb3b91ee88a3 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:41.896775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2975d15-f9c9-4658-982d-17b9f7eff739 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:41.908812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f37ff-fcef-4a23-a21b-07e2cfae351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:41.910050 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f37ff-fcef-4a23-a21b-07e2cfae351a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.910331 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f37ff-fcef-4a23-a21b-07e2cfae351a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.910601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f37ff-fcef-4a23-a21b-07e2cfae351a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.924040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f37ff-fcef-4a23-a21b-07e2cfae351a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:41.925280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-f34f37ff-fcef-4a23-a21b-07e2cfae351a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:41.931890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:41.933201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 405/803] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:41.934131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa37a9-1f18-4d45-b43f-3ab9a946d1d7 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.935059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa37a9-1f18-4d45-b43f-3ab9a946d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.935059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa37a9-1f18-4d45-b43f-3ab9a946d1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.953970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e7aa37a9-1f18-4d45-b43f-3ab9a946d1d7 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:41.954994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e7aa37a9-1f18-4d45-b43f-3ab9a946d1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:41.955458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da0a2b-7349-4b0a-a321-b665931f4b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:41.956085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da0a2b-7349-4b0a-a321-b665931f4b8c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:41.956464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da0a2b-7349-4b0a-a321-b665931f4b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:41.957040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da0a2b-7349-4b0a-a321-b665931f4b8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:41.959071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da0a2b-7349-4b0a-a321-b665931f4b8c None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=b0096da9bf564ceca61af67cac713f30) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:41.959439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da0a2b-7349-4b0a-a321-b665931f4b8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:41.960901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da0a2b-7349-4b0a-a321-b665931f4b8c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:41.968304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 399/804] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:41 2022] GET /identity/v3/role_assignments?user.id=b0096da9bf564ceca61af67cac713f30&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=999cac3070e64b82b981258349005963 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:41.969421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da0a2b-7349-4b0a-a321-b665931f4b8c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:42.037085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 406/805] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:42.062895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa37a9-1f18-4d45-b43f-3ab9a946d1d7 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:42.106219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:42.119554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da0a2b-7349-4b0a-a321-b665931f4b8c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:42.163761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce3514-5e94-41ca-b5dd-06a1a2874fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:42.164479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce3514-5e94-41ca-b5dd-06a1a2874fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.164763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce3514-5e94-41ca-b5dd-06a1a2874fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.165043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce3514-5e94-41ca-b5dd-06a1a2874fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.165894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce3514-5e94-41ca-b5dd-06a1a2874fe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:42.166198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce3514-5e94-41ca-b5dd-06a1a2874fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:42.167571 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce3514-5e94-41ca-b5dd-06a1a2874fe7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:42.182977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 400/806] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:42.184572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8daf-322d-458a-88d4-cee02b086d50 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.184858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8daf-322d-458a-88d4-cee02b086d50 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.185134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8daf-322d-458a-88d4-cee02b086d50 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.187397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 401/807] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:42.194698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8daf-322d-458a-88d4-cee02b086d50 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:42.208880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa37a9-1f18-4d45-b43f-3ab9a946d1d7 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:42.254938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:42.255312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1e17a-f75c-41ee-bc38-936b93fb4db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:42.255910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1e17a-f75c-41ee-bc38-936b93fb4db8 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.256824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1e17a-f75c-41ee-bc38-936b93fb4db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.256824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1e17a-f75c-41ee-bc38-936b93fb4db8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.276243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1e17a-f75c-41ee-bc38-936b93fb4db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-a5c1e17a-f75c-41ee-bc38-936b93fb4db8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:42.281455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:42.282371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:42.283200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:42.288097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 407/808] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:42.289935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba009a-6da6-4c1a-8ca1-8bd6771ff4d1 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.290217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba009a-6da6-4c1a-8ca1-8bd6771ff4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.290488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba009a-6da6-4c1a-8ca1-8bd6771ff4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.308887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8bba009a-6da6-4c1a-8ca1-8bd6771ff4d1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:42.310171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8bba009a-6da6-4c1a-8ca1-8bd6771ff4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:42.335176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8daf-322d-458a-88d4-cee02b086d50 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:42.379160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b93f2e-927f-4b73-b172-687bde2f6d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:42.379774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b93f2e-927f-4b73-b172-687bde2f6d9e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.380089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b93f2e-927f-4b73-b172-687bde2f6d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.380412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b93f2e-927f-4b73-b172-687bde2f6d9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.394809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b93f2e-927f-4b73-b172-687bde2f6d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:42.396300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b93f2e-927f-4b73-b172-687bde2f6d9e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:42.402870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 408/809] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:42.402870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba009a-6da6-4c1a-8ca1-8bd6771ff4d1 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-63b93f2e-927f-4b73-b172-687bde2f6d9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:42.419031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:42.419967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:42.420876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:42.420876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:42.420876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:42.420876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:42.420876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 402/810] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:42.425866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b93f2e-927f-4b73-b172-687bde2f6d9e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:42.440081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:42.548303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:42.557135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba009a-6da6-4c1a-8ca1-8bd6771ff4d1 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:42.559444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b93f2e-927f-4b73-b172-687bde2f6d9e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:42.597848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aea40-5c4b-42fe-9c49-38956c837d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:42.598472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aea40-5c4b-42fe-9c49-38956c837d4c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.599297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aea40-5c4b-42fe-9c49-38956c837d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.599584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aea40-5c4b-42fe-9c49-38956c837d4c None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.600298 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aea40-5c4b-42fe-9c49-38956c837d4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:42.600601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aea40-5c4b-42fe-9c49-38956c837d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:42.602032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aea40-5c4b-42fe-9c49-38956c837d4c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:42.611958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 409/811] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:42.612901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aea40-5c4b-42fe-9c49-38956c837d4c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:42.613748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063044-25e0-431c-a4a1-93f3019e4f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:42.614652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063044-25e0-431c-a4a1-93f3019e4f2e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.615133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063044-25e0-431c-a4a1-93f3019e4f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.615841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063044-25e0-431c-a4a1-93f3019e4f2e None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.617850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063044-25e0-431c-a4a1-93f3019e4f2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:42.618375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063044-25e0-431c-a4a1-93f3019e4f2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:42.621225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063044-25e0-431c-a4a1-93f3019e4f2e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:42.639270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 403/812] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:42.640935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063044-25e0-431c-a4a1-93f3019e4f2e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:42.701633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:42.733667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aea40-5c4b-42fe-9c49-38956c837d4c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:42.767700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063044-25e0-431c-a4a1-93f3019e4f2e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:42.780741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf6441-1ff5-4f41-a04e-98942a48cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:42.782079 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf6441-1ff5-4f41-a04e-98942a48cec5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.782565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf6441-1ff5-4f41-a04e-98942a48cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.783296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf6441-1ff5-4f41-a04e-98942a48cec5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.784606 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf6441-1ff5-4f41-a04e-98942a48cec5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:42.787295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf6441-1ff5-4f41-a04e-98942a48cec5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-0ccf6441-1ff5-4f41-a04e-98942a48cec5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:42.800030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:42.801031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 02:23:42.801950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:42.803009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 410/813] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:42 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:42.809036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf6441-1ff5-4f41-a04e-98942a48cec5 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:42.819922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76773334-60ff-4309-996c-71f42b5716c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:42.821307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76773334-60ff-4309-996c-71f42b5716c2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.822270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76773334-60ff-4309-996c-71f42b5716c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.822784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76773334-60ff-4309-996c-71f42b5716c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.838498 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76773334-60ff-4309-996c-71f42b5716c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:42.840887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76773334-60ff-4309-996c-71f42b5716c2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-76773334-60ff-4309-996c-71f42b5716c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:42.861435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:42.862551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:42.863655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:42.863655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:42.863655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:42.863655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:42.865870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 404/814] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:42.867005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76773334-60ff-4309-996c-71f42b5716c2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:42.884782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:42.920769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf6441-1ff5-4f41-a04e-98942a48cec5 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:42.970816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547da25d-9029-421e-a303-23915e69ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:42.972547 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547da25d-9029-421e-a303-23915e69ee6f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:42.972990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547da25d-9029-421e-a303-23915e69ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:42.973450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547da25d-9029-421e-a303-23915e69ee6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:42.985637 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547da25d-9029-421e-a303-23915e69ee6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:42.987914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547da25d-9029-421e-a303-23915e69ee6f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:42.999589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76773334-60ff-4309-996c-71f42b5716c2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-547da25d-9029-421e-a303-23915e69ee6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:43.004409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:43.006078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:43.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:43.009305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 411/815] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:23:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:43.010253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547da25d-9029-421e-a303-23915e69ee6f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.012997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:43.045387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ea21a-2425-417d-9a79-c3c77df5f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.046298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ea21a-2425-417d-9a79-c3c77df5f741 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.046617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ea21a-2425-417d-9a79-c3c77df5f741 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.046994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ea21a-2425-417d-9a79-c3c77df5f741 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.047832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ea21a-2425-417d-9a79-c3c77df5f741 None admin] RBAC: Adding query filter params (name=network) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:43.048234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ea21a-2425-417d-9a79-c3c77df5f741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.049717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ea21a-2425-417d-9a79-c3c77df5f741 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.059354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 405/816] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:23:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:43.059354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ea21a-2425-417d-9a79-c3c77df5f741 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.142186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:43.151309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547da25d-9029-421e-a303-23915e69ee6f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.184435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ea21a-2425-417d-9a79-c3c77df5f741 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.193351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb5d94-3d03-4a16-9600-a25947e3fab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.193969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb5d94-3d03-4a16-9600-a25947e3fab8 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.194246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb5d94-3d03-4a16-9600-a25947e3fab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.194519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb5d94-3d03-4a16-9600-a25947e3fab8 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.195583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb5d94-3d03-4a16-9600-a25947e3fab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:43.195884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb5d94-3d03-4a16-9600-a25947e3fab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.197912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb5d94-3d03-4a16-9600-a25947e3fab8 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.218748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 412/817] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:43.219751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb5d94-3d03-4a16-9600-a25947e3fab8 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.226785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a5952-5c2b-467c-a0af-2baed1324dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.227412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a5952-5c2b-467c-a0af-2baed1324dbb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.227735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a5952-5c2b-467c-a0af-2baed1324dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.228012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a5952-5c2b-467c-a0af-2baed1324dbb None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.228818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a5952-5c2b-467c-a0af-2baed1324dbb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:43.229165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a5952-5c2b-467c-a0af-2baed1324dbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.230582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a5952-5c2b-467c-a0af-2baed1324dbb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.254487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 406/818] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:43.256115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a5952-5c2b-467c-a0af-2baed1324dbb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.285543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:43.327116 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb5d94-3d03-4a16-9600-a25947e3fab8 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.363016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6e23d-e6b2-4e0e-8304-cb99ec20f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.363624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6e23d-e6b2-4e0e-8304-cb99ec20f236 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.363904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6e23d-e6b2-4e0e-8304-cb99ec20f236 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.364178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6e23d-e6b2-4e0e-8304-cb99ec20f236 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.364622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a5952-5c2b-467c-a0af-2baed1324dbb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.364888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6e23d-e6b2-4e0e-8304-cb99ec20f236 None admin] RBAC: Adding query filter params (type=network) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:43.365187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6e23d-e6b2-4e0e-8304-cb99ec20f236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.366578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6e23d-e6b2-4e0e-8304-cb99ec20f236 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.372014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 413/819] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:43.372934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6e23d-e6b2-4e0e-8304-cb99ec20f236 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.396676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:43.403244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5eb48-1356-4bdb-8dc0-bcef7aac51e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.404420 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5eb48-1356-4bdb-8dc0-bcef7aac51e4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.405219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5eb48-1356-4bdb-8dc0-bcef7aac51e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.406034 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5eb48-1356-4bdb-8dc0-bcef7aac51e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.415803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5eb48-1356-4bdb-8dc0-bcef7aac51e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.417691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5eb48-1356-4bdb-8dc0-bcef7aac51e4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-51a5eb48-1356-4bdb-8dc0-bcef7aac51e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:43.430880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:43.432037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:43.433143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:43.435391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 407/820] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:43.436279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5eb48-1356-4bdb-8dc0-bcef7aac51e4 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.479746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6e23d-e6b2-4e0e-8304-cb99ec20f236 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.505718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:43.515204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c915c09-561c-4158-88ef-c390b931eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.515941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c915c09-561c-4158-88ef-c390b931eed0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.516305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c915c09-561c-4158-88ef-c390b931eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.516657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c915c09-561c-4158-88ef-c390b931eed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.527614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c915c09-561c-4158-88ef-c390b931eed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.529510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c915c09-561c-4158-88ef-c390b931eed0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-8c915c09-561c-4158-88ef-c390b931eed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:43.544734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:43.545882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:43.546984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:43.546984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:43.546984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:43.546984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:43.552744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 414/821] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:43.552744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c915c09-561c-4158-88ef-c390b931eed0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.553482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5eb48-1356-4bdb-8dc0-bcef7aac51e4 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.602150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c40f4d-76de-444a-b843-7ff3929e978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.603514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40f4d-76de-444a-b843-7ff3929e978b None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.603988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40f4d-76de-444a-b843-7ff3929e978b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.604443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40f4d-76de-444a-b843-7ff3929e978b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.605388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c40f4d-76de-444a-b843-7ff3929e978b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.607436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c40f4d-76de-444a-b843-7ff3929e978b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.640092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 408/822] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:23:43 2022] POST /identity/v3/endpoints => generated 337 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:43.641754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c40f4d-76de-444a-b843-7ff3929e978b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.659299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c915c09-561c-4158-88ef-c390b931eed0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.704351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12a5e1-c055-41f8-b4c3-e4f51280eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.705029 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a5e1-c055-41f8-b4c3-e4f51280eff2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.710086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a5e1-c055-41f8-b4c3-e4f51280eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.710086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a5e1-c055-41f8-b4c3-e4f51280eff2 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.710086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12a5e1-c055-41f8-b4c3-e4f51280eff2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:43.710086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12a5e1-c055-41f8-b4c3-e4f51280eff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.710086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12a5e1-c055-41f8-b4c3-e4f51280eff2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.725358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:43.733123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 415/823] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:43.734952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12a5e1-c055-41f8-b4c3-e4f51280eff2 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.773875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:43.821933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c40f4d-76de-444a-b843-7ff3929e978b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.849361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12a5e1-c055-41f8-b4c3-e4f51280eff2 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:43.883969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9b34-b809-42e2-922f-ec878c73a49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.884744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9b34-b809-42e2-922f-ec878c73a49e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.885092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9b34-b809-42e2-922f-ec878c73a49e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.885464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9b34-b809-42e2-922f-ec878c73a49e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.886005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaebaf0-f51e-41cf-93cb-bef7541d8427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:43.886857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaebaf0-f51e-41cf-93cb-bef7541d8427 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:43.887318 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaebaf0-f51e-41cf-93cb-bef7541d8427 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:43.887789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaebaf0-f51e-41cf-93cb-bef7541d8427 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:43.888689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaebaf0-f51e-41cf-93cb-bef7541d8427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:43.889171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaebaf0-f51e-41cf-93cb-bef7541d8427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.894300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaebaf0-f51e-41cf-93cb-bef7541d8427 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.898558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9b34-b809-42e2-922f-ec878c73a49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:43.900113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9b34-b809-42e2-922f-ec878c73a49e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-a02b9b34-b809-42e2-922f-ec878c73a49e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:43.917480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:43.918409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:43.919298 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:43.919298 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:43.919298 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:43.919298 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:43.919515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 409/824] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:43.922224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 416/825] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:43.925468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaebaf0-f51e-41cf-93cb-bef7541d8427 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:43.926140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9b34-b809-42e2-922f-ec878c73a49e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.025376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:44.044889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9b34-b809-42e2-922f-ec878c73a49e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.052584 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaebaf0-f51e-41cf-93cb-bef7541d8427 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.062574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:44.079420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d32de-d6ca-4af8-9698-e990905518c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.080057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d32de-d6ca-4af8-9698-e990905518c3 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.080337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d32de-d6ca-4af8-9698-e990905518c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.080613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d32de-d6ca-4af8-9698-e990905518c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.088032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d32de-d6ca-4af8-9698-e990905518c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.089498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d32de-d6ca-4af8-9698-e990905518c3 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.090849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b7c39-0aaf-4bea-bc98-90ea4ff3bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.091457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b7c39-0aaf-4bea-bc98-90ea4ff3bf2e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.091732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b7c39-0aaf-4bea-bc98-90ea4ff3bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.092173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b7c39-0aaf-4bea-bc98-90ea4ff3bf2e None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.092675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b7c39-0aaf-4bea-bc98-90ea4ff3bf2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:44.092972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b7c39-0aaf-4bea-bc98-90ea4ff3bf2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.094341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b7c39-0aaf-4bea-bc98-90ea4ff3bf2e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-ab3d32de-d6ca-4af8-9698-e990905518c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:44.101833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:44.102714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:44.103578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:44.103578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:44.103578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:44.103578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:44.103578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:44.103578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:44.103578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:44.103578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:44.105480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 417/826] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:44.106978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a72af2-cfff-4709-9ba9-b22c3e9a4f37 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.111494 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 410/827] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:44.111494 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b7c39-0aaf-4bea-bc98-90ea4ff3bf2e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.111719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a72af2-cfff-4709-9ba9-b22c3e9a4f37 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.111719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a72af2-cfff-4709-9ba9-b22c3e9a4f37 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.111719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 418/828] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:44.113180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a72af2-cfff-4709-9ba9-b22c3e9a4f37 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.218129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b7c39-0aaf-4bea-bc98-90ea4ff3bf2e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.219094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a72af2-cfff-4709-9ba9-b22c3e9a4f37 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.251661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d248fc1-e193-4e1e-ba89-fe5e037d120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.252166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248fc1-e193-4e1e-ba89-fe5e037d120b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.252451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248fc1-e193-4e1e-ba89-fe5e037d120b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.252714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d248fc1-e193-4e1e-ba89-fe5e037d120b None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.253510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d248fc1-e193-4e1e-ba89-fe5e037d120b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:44.253786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d248fc1-e193-4e1e-ba89-fe5e037d120b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.254283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93e52-394d-409a-83fc-3adf76de0d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.254952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93e52-394d-409a-83fc-3adf76de0d9c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.255231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93e52-394d-409a-83fc-3adf76de0d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.255368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d248fc1-e193-4e1e-ba89-fe5e037d120b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.255504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93e52-394d-409a-83fc-3adf76de0d9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.262120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d93e52-394d-409a-83fc-3adf76de0d9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.263528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d93e52-394d-409a-83fc-3adf76de0d9c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.267291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 411/829] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:44.268579 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6018aa-4433-4960-b0e3-92bafd62c6ee None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.268861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6018aa-4433-4960-b0e3-92bafd62c6ee None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.269129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6018aa-4433-4960-b0e3-92bafd62c6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-c7d93e52-394d-409a-83fc-3adf76de0d9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:44.275262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:44.276155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:44.277139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:44.277139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:44.277139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:44.277139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:44.277139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:44.277139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:44.277139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:44.277139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:44.277139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 419/830] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:44.278121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc65482-d7de-419a-bf46-1c1f76fdc393 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.278121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc65482-d7de-419a-bf46-1c1f76fdc393 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.278370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc65482-d7de-419a-bf46-1c1f76fdc393 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.281456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 420/831] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:44.281456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc65482-d7de-419a-bf46-1c1f76fdc393 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.287109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:44.288223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2d6018aa-4433-4960-b0e3-92bafd62c6ee None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:44.289714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2d6018aa-4433-4960-b0e3-92bafd62c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:44.312215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:44.355993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 412/832] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:44.356811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6018aa-4433-4960-b0e3-92bafd62c6ee None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.391487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc65482-d7de-419a-bf46-1c1f76fdc393 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.424118 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068104e1-c98a-4b35-8698-3d8d86b45ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.424776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068104e1-c98a-4b35-8698-3d8d86b45ebb None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.425072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068104e1-c98a-4b35-8698-3d8d86b45ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.425341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068104e1-c98a-4b35-8698-3d8d86b45ebb None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/758a5ce9caf046929eec499e6afc1dd8/roles/a60b7cc5e9e5429aafb8b22f5712c493` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.439632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068104e1-c98a-4b35-8698-3d8d86b45ebb None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=758a5ce9caf046929eec499e6afc1dd8, role_id=a60b7cc5e9e5429aafb8b22f5712c493)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.441052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068104e1-c98a-4b35-8698-3d8d86b45ebb None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.453785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 421/833] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:23:44 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/758a5ce9caf046929eec499e6afc1dd8/roles/a60b7cc5e9e5429aafb8b22f5712c493 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:23:44.454327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6018aa-4433-4960-b0e3-92bafd62c6ee None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.454978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566672-ad76-4b15-a0b9-c95ccea390a0 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.455265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566672-ad76-4b15-a0b9-c95ccea390a0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.455542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566672-ad76-4b15-a0b9-c95ccea390a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.477924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-fc566672-ad76-4b15-a0b9-c95ccea390a0 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:44.479162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fc566672-ad76-4b15-a0b9-c95ccea390a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:44.500608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb653b20-ff13-4387-a974-4cb2acb9815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.501251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb653b20-ff13-4387-a974-4cb2acb9815f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.501566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb653b20-ff13-4387-a974-4cb2acb9815f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.501845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb653b20-ff13-4387-a974-4cb2acb9815f None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.502630 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb653b20-ff13-4387-a974-4cb2acb9815f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:44.502939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb653b20-ff13-4387-a974-4cb2acb9815f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.504435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb653b20-ff13-4387-a974-4cb2acb9815f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.518330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 413/834] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:44.519252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb653b20-ff13-4387-a974-4cb2acb9815f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.542825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:44.543798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:44.565022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 422/835] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:44.566014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc566672-ad76-4b15-a0b9-c95ccea390a0 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.656383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb653b20-ff13-4387-a974-4cb2acb9815f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.685793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc566672-ad76-4b15-a0b9-c95ccea390a0 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.697448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49834d64-f990-4e73-8c70-903b56f6d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.698098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49834d64-f990-4e73-8c70-903b56f6d91c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.698377 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49834d64-f990-4e73-8c70-903b56f6d91c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.698651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49834d64-f990-4e73-8c70-903b56f6d91c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.699276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49834d64-f990-4e73-8c70-903b56f6d91c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.700642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49834d64-f990-4e73-8c70-903b56f6d91c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-49834d64-f990-4e73-8c70-903b56f6d91c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:44.711194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:44.712237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:44.714044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 414/836] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:44.714851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49834d64-f990-4e73-8c70-903b56f6d91c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.727781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2ec47-df64-4f85-aebd-552642ad0c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.728457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2ec47-df64-4f85-aebd-552642ad0c72 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.728737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2ec47-df64-4f85-aebd-552642ad0c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.729103 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2ec47-df64-4f85-aebd-552642ad0c72 None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/d7e996ea899e4bf8a65b721628a044ec/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.730992 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2ec47-df64-4f85-aebd-552642ad0c72 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=d7e996ea899e4bf8a65b721628a044ec, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.732480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2ec47-df64-4f85-aebd-552642ad0c72 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.747383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 423/837] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:23:44 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/d7e996ea899e4bf8a65b721628a044ec/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:23:44.748221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2ec47-df64-4f85-aebd-552642ad0c72 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.803594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:44.824075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:44.844926 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49834d64-f990-4e73-8c70-903b56f6d91c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.869587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2ec47-df64-4f85-aebd-552642ad0c72 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:44.882992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910674c-3ceb-4cc4-b082-a1681b13c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.884048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910674c-3ceb-4cc4-b082-a1681b13c36f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.884523 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910674c-3ceb-4cc4-b082-a1681b13c36f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.884992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910674c-3ceb-4cc4-b082-a1681b13c36f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.885860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910674c-3ceb-4cc4-b082-a1681b13c36f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.887455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910674c-3ceb-4cc4-b082-a1681b13c36f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-b910674c-3ceb-4cc4-b082-a1681b13c36f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:44.897215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:44.898230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:23:44.899073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:44.902545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 415/838] 10.222.0.69 () {56 vars in 1132 bytes} [Thu Aug 4 02:23:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:44.909297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910674c-3ceb-4cc4-b082-a1681b13c36f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:44.917599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aba667-e9ab-49f4-9385-f35df58fbc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:44.918291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aba667-e9ab-49f4-9385-f35df58fbc97 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:44.918576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aba667-e9ab-49f4-9385-f35df58fbc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:44.918855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aba667-e9ab-49f4-9385-f35df58fbc97 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:44.919603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aba667-e9ab-49f4-9385-f35df58fbc97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:44.919911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aba667-e9ab-49f4-9385-f35df58fbc97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:44.921476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aba667-e9ab-49f4-9385-f35df58fbc97 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:44.927543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 424/839] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:44.932808 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aba667-e9ab-49f4-9385-f35df58fbc97 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:45.028215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910674c-3ceb-4cc4-b082-a1681b13c36f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:45.060715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aba667-e9ab-49f4-9385-f35df58fbc97 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:45.065629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05fc16-651b-4ace-a8cf-3b32cc9f514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:45.066375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05fc16-651b-4ace-a8cf-3b32cc9f514a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:45.066789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05fc16-651b-4ace-a8cf-3b32cc9f514a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:45.067138 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05fc16-651b-4ace-a8cf-3b32cc9f514a None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:45.068445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05fc16-651b-4ace-a8cf-3b32cc9f514a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:45.068825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05fc16-651b-4ace-a8cf-3b32cc9f514a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:45.070299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05fc16-651b-4ace-a8cf-3b32cc9f514a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:45.078278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:45.085146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 416/840] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:23:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:45.090882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05fc16-651b-4ace-a8cf-3b32cc9f514a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:45.109027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:45.115368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f607bde-93d9-490a-a7a7-4f765f784cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:45.115997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f607bde-93d9-490a-a7a7-4f765f784cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:45.116283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f607bde-93d9-490a-a7a7-4f765f784cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:45.116559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f607bde-93d9-490a-a7a7-4f765f784cc2 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:45.117301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f607bde-93d9-490a-a7a7-4f765f784cc2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:45.117642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f607bde-93d9-490a-a7a7-4f765f784cc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:45.119254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f607bde-93d9-490a-a7a7-4f765f784cc2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:45.124671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 425/841] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:45.213118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05fc16-651b-4ace-a8cf-3b32cc9f514a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:45.251400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873e2e6-9598-4245-9b6d-475f00ef4c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:45.252292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e2e6-9598-4245-9b6d-475f00ef4c02 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:45.252721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e2e6-9598-4245-9b6d-475f00ef4c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:45.253139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873e2e6-9598-4245-9b6d-475f00ef4c02 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:45.254093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873e2e6-9598-4245-9b6d-475f00ef4c02 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:45.254540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873e2e6-9598-4245-9b6d-475f00ef4c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:45.256307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873e2e6-9598-4245-9b6d-475f00ef4c02 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:45.262437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 417/842] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:23:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:46.475347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeae267-5d07-4388-b9ef-3538f1d2f053 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:46.476219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeae267-5d07-4388-b9ef-3538f1d2f053 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:46.476639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeae267-5d07-4388-b9ef-3538f1d2f053 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:46.478603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 426/843] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:46.483947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c109676-5094-4534-917f-de2507fda99a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:46.484772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c109676-5094-4534-917f-de2507fda99a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:46.485256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c109676-5094-4534-917f-de2507fda99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:46.503817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6c109676-5094-4534-917f-de2507fda99a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:46.505411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6c109676-5094-4534-917f-de2507fda99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:46.582203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 418/844] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:46.605279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeae267-5d07-4388-b9ef-3538f1d2f053 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:46.717852 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeae267-5d07-4388-b9ef-3538f1d2f053 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:46.753917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562ccab-2487-404f-a2d7-15cdb01d2920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:46.754475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562ccab-2487-404f-a2d7-15cdb01d2920 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:46.755283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562ccab-2487-404f-a2d7-15cdb01d2920 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:46.755558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562ccab-2487-404f-a2d7-15cdb01d2920 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:46.766189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562ccab-2487-404f-a2d7-15cdb01d2920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-9562ccab-2487-404f-a2d7-15cdb01d2920 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:46.771737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:46.772696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:46.773570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 427/845] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:23:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:46.781061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c109676-5094-4534-917f-de2507fda99a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:46.784577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:46.826032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ed498-ec84-44d9-81ee-1ac52b96437a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:46.826351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ed498-ec84-44d9-81ee-1ac52b96437a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:46.826591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ed498-ec84-44d9-81ee-1ac52b96437a None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:46.828214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 428/846] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:46.833673 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a749-d7d5-4969-89e0-11179e735817 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:46.833957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a749-d7d5-4969-89e0-11179e735817 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:46.834228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24a749-d7d5-4969-89e0-11179e735817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:46.854955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-5e24a749-d7d5-4969-89e0-11179e735817 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:46.854955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-5e24a749-d7d5-4969-89e0-11179e735817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:46.881886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:46.893178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c109676-5094-4534-917f-de2507fda99a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:46.930568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4d0db-4da9-4f54-a76a-00cb0dde82b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:46.931228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d0db-4da9-4f54-a76a-00cb0dde82b9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:46.931514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d0db-4da9-4f54-a76a-00cb0dde82b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:46.931791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d0db-4da9-4f54-a76a-00cb0dde82b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:46.932509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4d0db-4da9-4f54-a76a-00cb0dde82b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:46.932804 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4d0db-4da9-4f54-a76a-00cb0dde82b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:46.934292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4d0db-4da9-4f54-a76a-00cb0dde82b9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:46.945812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 429/847] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:23:46.949104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 419/848] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:23:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:46.954371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24a749-d7d5-4969-89e0-11179e735817 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:46.965823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4d0db-4da9-4f54-a76a-00cb0dde82b9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.036319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:47.058641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24a749-d7d5-4969-89e0-11179e735817 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.077420 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4d0db-4da9-4f54-a76a-00cb0dde82b9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.094354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b085123-062f-4015-b811-400b98ac6752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:47.095001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b085123-062f-4015-b811-400b98ac6752 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.095285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b085123-062f-4015-b811-400b98ac6752 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.095557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b085123-062f-4015-b811-400b98ac6752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.106152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b085123-062f-4015-b811-400b98ac6752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:47.107691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b085123-062f-4015-b811-400b98ac6752 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:47.116364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5aa9-c944-446f-b023-902d4ac68df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:47.117429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5aa9-c944-446f-b023-902d4ac68df4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.117920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5aa9-c944-446f-b023-902d4ac68df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.118470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5aa9-c944-446f-b023-902d4ac68df4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-3b085123-062f-4015-b811-400b98ac6752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:47.123686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:47.124578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:47.125489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:47.125489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:47.125489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:47.125489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:47.130374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 430/849] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:47.131044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b085123-062f-4015-b811-400b98ac6752 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.133838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba5aa9-c944-446f-b023-902d4ac68df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-23ba5aa9-c944-446f-b023-902d4ac68df4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:47.139642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:47.140562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:23:47.141418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:47.148879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 420/850] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:47.150389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:47.150876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5aa9-c944-446f-b023-902d4ac68df4 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.239558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b085123-062f-4015-b811-400b98ac6752 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.260337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5aa9-c944-446f-b023-902d4ac68df4 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.276832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f135938-1760-4f58-b1a7-2c21abfc23ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:47.277475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f135938-1760-4f58-b1a7-2c21abfc23ff None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.277779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f135938-1760-4f58-b1a7-2c21abfc23ff None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.278059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f135938-1760-4f58-b1a7-2c21abfc23ff None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.279011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f135938-1760-4f58-b1a7-2c21abfc23ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:47.279311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f135938-1760-4f58-b1a7-2c21abfc23ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:47.280663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f135938-1760-4f58-b1a7-2c21abfc23ff None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:47.287111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:47.293275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 431/851] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:47.294566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e2c88-5c22-4cca-95cb-57031e940c44 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.294857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e2c88-5c22-4cca-95cb-57031e940c44 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.295132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e2c88-5c22-4cca-95cb-57031e940c44 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.296232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77280385-5e60-468a-80e6-1959de817790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:47.296635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 432/852] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:47.297821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457eac-f4a5-4be5-9fe7-d5d46badb84c None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.298107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457eac-f4a5-4be5-9fe7-d5d46badb84c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.298301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280385-5e60-468a-80e6-1959de817790 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.298424 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457eac-f4a5-4be5-9fe7-d5d46badb84c None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.298882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280385-5e60-468a-80e6-1959de817790 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.299344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280385-5e60-468a-80e6-1959de817790 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.299552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 433/853] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:47.300383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457eac-f4a5-4be5-9fe7-d5d46badb84c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.300638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77280385-5e60-468a-80e6-1959de817790 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:47.301047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77280385-5e60-468a-80e6-1959de817790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:47.302473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77280385-5e60-468a-80e6-1959de817790 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:47.312072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 421/854] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:47.314610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392510ff-2af4-4313-a975-723ccb0c3a4b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.314894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392510ff-2af4-4313-a975-723ccb0c3a4b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.315167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392510ff-2af4-4313-a975-723ccb0c3a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.333948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-392510ff-2af4-4313-a975-723ccb0c3a4b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:47.335121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-392510ff-2af4-4313-a975-723ccb0c3a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:47.377986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:47.400735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 422/855] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:47.401987 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcfb54-66f6-4f3c-9aae-f73fc9843e5e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.402271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcfb54-66f6-4f3c-9aae-f73fc9843e5e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.402543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcfb54-66f6-4f3c-9aae-f73fc9843e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.404718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457eac-f4a5-4be5-9fe7-d5d46badb84c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.420267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e6fcfb54-66f6-4f3c-9aae-f73fc9843e5e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:47.421479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e6fcfb54-66f6-4f3c-9aae-f73fc9843e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:47.439279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c61fb-689e-4825-9ece-4202ceba9572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:47.439914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c61fb-689e-4825-9ece-4202ceba9572 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.440189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c61fb-689e-4825-9ece-4202ceba9572 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.440460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c61fb-689e-4825-9ece-4202ceba9572 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.447858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c61fb-689e-4825-9ece-4202ceba9572 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:47.449264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c61fb-689e-4825-9ece-4202ceba9572 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-818c61fb-689e-4825-9ece-4202ceba9572 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:47.462400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:47.463519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 434/856] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:23:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:47.464470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c61fb-689e-4825-9ece-4202ceba9572 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.489560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 423/857] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:47.490299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcfb54-66f6-4f3c-9aae-f73fc9843e5e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.548988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:47.565095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c61fb-689e-4825-9ece-4202ceba9572 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.599578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1a57-3da9-4a3c-b010-0c47031c4803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:47.600215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1a57-3da9-4a3c-b010-0c47031c4803 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.600500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1a57-3da9-4a3c-b010-0c47031c4803 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.600773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c1a57-3da9-4a3c-b010-0c47031c4803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.602658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:47.603380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcfb54-66f6-4f3c-9aae-f73fc9843e5e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.612295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c1a57-3da9-4a3c-b010-0c47031c4803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:47.613754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c1a57-3da9-4a3c-b010-0c47031c4803 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-383c1a57-3da9-4a3c-b010-0c47031c4803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:47.627726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:47.628640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:47.629540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:47.629540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:47.629540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:47.629540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:47.629540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 435/858] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:47.630583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1a57-3da9-4a3c-b010-0c47031c4803 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.640373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0fb6f-19fd-414a-8ac2-b06dbcc4911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:47.640981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0fb6f-19fd-414a-8ac2-b06dbcc4911b None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.641254 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0fb6f-19fd-414a-8ac2-b06dbcc4911b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.641566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0fb6f-19fd-414a-8ac2-b06dbcc4911b None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.642245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0fb6f-19fd-414a-8ac2-b06dbcc4911b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:47.643628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0fb6f-19fd-414a-8ac2-b06dbcc4911b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:47.658849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 424/859] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:23:47 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:47.659615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0fb6f-19fd-414a-8ac2-b06dbcc4911b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.739982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c1a57-3da9-4a3c-b010-0c47031c4803 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.783950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6e2fb-5506-4eea-bb46-ebcf120151cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:47.784585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6e2fb-5506-4eea-bb46-ebcf120151cc None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.784856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6e2fb-5506-4eea-bb46-ebcf120151cc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.785130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6e2fb-5506-4eea-bb46-ebcf120151cc None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.786012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6e2fb-5506-4eea-bb46-ebcf120151cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:47.786320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6e2fb-5506-4eea-bb46-ebcf120151cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:47.787234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0fb6f-19fd-414a-8ac2-b06dbcc4911b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.787767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6e2fb-5506-4eea-bb46-ebcf120151cc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:47.791563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:47.816588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 436/860] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Aug 4 02:23:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:47.816588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6e2fb-5506-4eea-bb46-ebcf120151cc None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.830531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb55f-8b53-449a-9120-f810cc894a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:47.831150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb55f-8b53-449a-9120-f810cc894a71 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:47.831429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb55f-8b53-449a-9120-f810cc894a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:47.831700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb55f-8b53-449a-9120-f810cc894a71 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:47.832404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb55f-8b53-449a-9120-f810cc894a71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:47.833871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb55f-8b53-449a-9120-f810cc894a71 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:47.852172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 425/861] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:23:47 2022] POST /identity/v3/services => generated 269 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:47.853041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb55f-8b53-449a-9120-f810cc894a71 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:47.872847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:47.954532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6e2fb-5506-4eea-bb46-ebcf120151cc None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.994412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb55f-8b53-449a-9120-f810cc894a71 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:47.999401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3d326-8a3c-48c6-bc96-31be07e6699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:48.000025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d326-8a3c-48c6-bc96-31be07e6699e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:48.000299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d326-8a3c-48c6-bc96-31be07e6699e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:48.000566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3d326-8a3c-48c6-bc96-31be07e6699e None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:48.001251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3d326-8a3c-48c6-bc96-31be07e6699e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:48.001578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3d326-8a3c-48c6-bc96-31be07e6699e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:48.002951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd3d326-8a3c-48c6-bc96-31be07e6699e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:48.017200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 437/862] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:48.023053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3d326-8a3c-48c6-bc96-31be07e6699e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:48.037836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc886e-1491-4267-b2d6-633874804bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:48.039100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc886e-1491-4267-b2d6-633874804bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:48.039705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc886e-1491-4267-b2d6-633874804bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:48.040259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc886e-1491-4267-b2d6-633874804bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:48.075223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:48.118613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc886e-1491-4267-b2d6-633874804bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:48.120108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc886e-1491-4267-b2d6-633874804bb8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:48.142835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:48.152106 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd3d326-8a3c-48c6-bc96-31be07e6699e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:48.192739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95299b-34cd-456b-844a-5f808055aaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:48.193448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95299b-34cd-456b-844a-5f808055aaaf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:48.193734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95299b-34cd-456b-844a-5f808055aaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:48.194010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95299b-34cd-456b-844a-5f808055aaaf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:48.202275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95299b-34cd-456b-844a-5f808055aaaf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:48.203840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95299b-34cd-456b-844a-5f808055aaaf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-fa95299b-34cd-456b-844a-5f808055aaaf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:48.216380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:48.217559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:48.218802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 438/863] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:23:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:48.226900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95299b-34cd-456b-844a-5f808055aaaf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:48.231378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 426/864] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:47 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:23:48.237212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc886e-1491-4267-b2d6-633874804bb8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:48.316970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:48.338589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95299b-34cd-456b-844a-5f808055aaaf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:48.373790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc886e-1491-4267-b2d6-633874804bb8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:48.375730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228b0a6-5458-4381-bc6c-416759a8dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:48.376531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228b0a6-5458-4381-bc6c-416759a8dff4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:48.376991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228b0a6-5458-4381-bc6c-416759a8dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:48.377579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228b0a6-5458-4381-bc6c-416759a8dff4 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:48.378516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228b0a6-5458-4381-bc6c-416759a8dff4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:48.378982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228b0a6-5458-4381-bc6c-416759a8dff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:48.381060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228b0a6-5458-4381-bc6c-416759a8dff4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:48.405437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 439/865] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Aug 4 02:23:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:48.407001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228b0a6-5458-4381-bc6c-416759a8dff4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:48.415423 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2a332-bff9-453a-8380-af680d187759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:48.416071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2a332-bff9-453a-8380-af680d187759 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:48.416354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2a332-bff9-453a-8380-af680d187759 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:48.417122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2a332-bff9-453a-8380-af680d187759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:48.424604 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:48.431935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2a332-bff9-453a-8380-af680d187759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:48.434178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2a332-bff9-453a-8380-af680d187759 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-18c2a332-bff9-453a-8380-af680d187759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:48.458741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:48.459848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:48.465398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:48.465398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:48.465398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:48.465398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:48.465398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 427/866] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:48.470814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2a332-bff9-453a-8380-af680d187759 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:48.532830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228b0a6-5458-4381-bc6c-416759a8dff4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:48.576013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2a332-bff9-453a-8380-af680d187759 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:48.577208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf01fc2-14f3-42aa-85c9-22e8e39038de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:48.577947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf01fc2-14f3-42aa-85c9-22e8e39038de None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:48.578293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf01fc2-14f3-42aa-85c9-22e8e39038de None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:48.578650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf01fc2-14f3-42aa-85c9-22e8e39038de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:48.594387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:48.620811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f8389-c778-45b9-ab5d-25e887181d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:48.621764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f8389-c778-45b9-ab5d-25e887181d27 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:48.622277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f8389-c778-45b9-ab5d-25e887181d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:48.622755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f8389-c778-45b9-ab5d-25e887181d27 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:48.623646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f8389-c778-45b9-ab5d-25e887181d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:48.624170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f8389-c778-45b9-ab5d-25e887181d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:48.625764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f8389-c778-45b9-ab5d-25e887181d27 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:48.638781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 428/867] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:48.645861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f8389-c778-45b9-ab5d-25e887181d27 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:48.667039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf01fc2-14f3-42aa-85c9-22e8e39038de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:48.668482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf01fc2-14f3-42aa-85c9-22e8e39038de None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:48.683333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:48.771388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f8389-c778-45b9-ab5d-25e887181d27 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:48.780868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 440/868] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:23:48.788014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf01fc2-14f3-42aa-85c9-22e8e39038de None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:48.821211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305dd19-29c1-4191-a927-3df9408c6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:48.822360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305dd19-29c1-4191-a927-3df9408c6279 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:48.823656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305dd19-29c1-4191-a927-3df9408c6279 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:48.824159 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305dd19-29c1-4191-a927-3df9408c6279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:48.833643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305dd19-29c1-4191-a927-3df9408c6279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:48.836092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305dd19-29c1-4191-a927-3df9408c6279 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-6305dd19-29c1-4191-a927-3df9408c6279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:48.853853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:48.854764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:48.855635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:48.855635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:48.855635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:48.855635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:48.855635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:48.855635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:48.855635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:48.855635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:48.858696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 429/869] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:48.863993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305dd19-29c1-4191-a927-3df9408c6279 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:48.893287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf01fc2-14f3-42aa-85c9-22e8e39038de None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:48.899375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:48.908900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:48.931971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6276-ebc7-443b-bfda-a8afe32d54e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:48.932611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6276-ebc7-443b-bfda-a8afe32d54e9 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:48.932892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6276-ebc7-443b-bfda-a8afe32d54e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:48.933158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6276-ebc7-443b-bfda-a8afe32d54e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:48.943714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd6276-ebc7-443b-bfda-a8afe32d54e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:48.945368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd6276-ebc7-443b-bfda-a8afe32d54e9 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-bcbd6276-ebc7-443b-bfda-a8afe32d54e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:48.960290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:48.961176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:48.962088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:48.962088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:48.962088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:48.962088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:48.966052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 441/870] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:48.966910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6276-ebc7-443b-bfda-a8afe32d54e9 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:48.979075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305dd19-29c1-4191-a927-3df9408c6279 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:49.015082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f37c1b-85aa-449a-92b5-e2d10d7bb716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:49.016053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f37c1b-85aa-449a-92b5-e2d10d7bb716 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.016544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f37c1b-85aa-449a-92b5-e2d10d7bb716 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.017008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f37c1b-85aa-449a-92b5-e2d10d7bb716 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:49.017972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f37c1b-85aa-449a-92b5-e2d10d7bb716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:49.018474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f37c1b-85aa-449a-92b5-e2d10d7bb716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:49.020093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f37c1b-85aa-449a-92b5-e2d10d7bb716 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:49.032905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 430/871] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:49.041371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f37c1b-85aa-449a-92b5-e2d10d7bb716 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:49.073252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6276-ebc7-443b-bfda-a8afe32d54e9 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:49.112152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51333d5d-7f65-43a5-8712-8c97bdceeb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:49.112691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51333d5d-7f65-43a5-8712-8c97bdceeb6b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.112970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51333d5d-7f65-43a5-8712-8c97bdceeb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.113244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51333d5d-7f65-43a5-8712-8c97bdceeb6b None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:49.114551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51333d5d-7f65-43a5-8712-8c97bdceeb6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:49.114862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51333d5d-7f65-43a5-8712-8c97bdceeb6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:49.116321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51333d5d-7f65-43a5-8712-8c97bdceeb6b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:49.135518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 442/872] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:49.136408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51333d5d-7f65-43a5-8712-8c97bdceeb6b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:49.143030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:49.152691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f37c1b-85aa-449a-92b5-e2d10d7bb716 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:49.165339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:49.189851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1460-2d3b-4162-974f-28f8f86f6d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:49.190718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1460-2d3b-4162-974f-28f8f86f6d3a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.191139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1460-2d3b-4162-974f-28f8f86f6d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.191553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1460-2d3b-4162-974f-28f8f86f6d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:49.192530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1460-2d3b-4162-974f-28f8f86f6d3a None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=758a5ce9caf046929eec499e6afc1dd8) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:49.193006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1460-2d3b-4162-974f-28f8f86f6d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:49.194612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c1460-2d3b-4162-974f-28f8f86f6d3a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:49.201095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 431/873] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:49 2022] GET /identity/v3/role_assignments?user.id=758a5ce9caf046929eec499e6afc1dd8&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:49.252872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51333d5d-7f65-43a5-8712-8c97bdceeb6b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:49.293046 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe77ee-767d-4581-a0a1-e3680f0646fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:49.293733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe77ee-767d-4581-a0a1-e3680f0646fe None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.294013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe77ee-767d-4581-a0a1-e3680f0646fe None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.294286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe77ee-767d-4581-a0a1-e3680f0646fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:49.302366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe77ee-767d-4581-a0a1-e3680f0646fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:49.303900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe77ee-767d-4581-a0a1-e3680f0646fe None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-17fe77ee-767d-4581-a0a1-e3680f0646fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:49.316662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:49.318214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:49.319092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:49.319092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:49.319092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:49.319092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:49.319092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:49.319092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:49.319092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:49.319092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:49.319092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 443/874] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:49.324706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1460-2d3b-4162-974f-28f8f86f6d3a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:49.434022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1460-2d3b-4162-974f-28f8f86f6d3a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:49.470173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1eea2-93ce-48af-a477-023099b2de94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:49.470789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1eea2-93ce-48af-a477-023099b2de94 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.471065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1eea2-93ce-48af-a477-023099b2de94 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.471337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1eea2-93ce-48af-a477-023099b2de94 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:49.472080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1eea2-93ce-48af-a477-023099b2de94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:49.472382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1eea2-93ce-48af-a477-023099b2de94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:49.474430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1eea2-93ce-48af-a477-023099b2de94 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:49.487845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 432/875] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:49.493984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe77ee-767d-4581-a0a1-e3680f0646fe None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:49.597238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:49.612179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe77ee-767d-4581-a0a1-e3680f0646fe None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:49.648614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3718906-92f0-4de5-9b9b-90c40ba361d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:49.649233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3718906-92f0-4de5-9b9b-90c40ba361d1 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.649541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3718906-92f0-4de5-9b9b-90c40ba361d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.649814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3718906-92f0-4de5-9b9b-90c40ba361d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:49.650604 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3718906-92f0-4de5-9b9b-90c40ba361d1 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=d7e996ea899e4bf8a65b721628a044ec) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:49.650907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3718906-92f0-4de5-9b9b-90c40ba361d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:49.652329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3718906-92f0-4de5-9b9b-90c40ba361d1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:49.659294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 444/876] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:49 2022] GET /identity/v3/role_assignments?user.id=d7e996ea899e4bf8a65b721628a044ec&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=999cac3070e64b82b981258349005963 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:49.805836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6cbbc-9f0e-4c9e-9843-06aa2fc5693c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.806348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6cbbc-9f0e-4c9e-9843-06aa2fc5693c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.806348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6cbbc-9f0e-4c9e-9843-06aa2fc5693c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:49.807686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 433/877] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:49.813243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc4383-f110-4ac7-b57c-3bc528b572b8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.813561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc4383-f110-4ac7-b57c-3bc528b572b8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.813839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc4383-f110-4ac7-b57c-3bc528b572b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:49.832730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-95bc4383-f110-4ac7-b57c-3bc528b572b8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:49.833952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-95bc4383-f110-4ac7-b57c-3bc528b572b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:49.909729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 445/878] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:49.932591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6cbbc-9f0e-4c9e-9843-06aa2fc5693c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:49.951690 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:49.982084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa30f80-a434-46b7-8556-875b0ea5c9ea None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.982084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa30f80-a434-46b7-8556-875b0ea5c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.982366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa30f80-a434-46b7-8556-875b0ea5c9ea None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:49.984092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 446/879] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:49.988677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357d20-5cb7-4918-b2e8-5f64bc5f0654 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:49.989003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357d20-5cb7-4918-b2e8-5f64bc5f0654 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:49.989281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1357d20-5cb7-4918-b2e8-5f64bc5f0654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.010837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e1357d20-5cb7-4918-b2e8-5f64bc5f0654 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:50.012047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e1357d20-5cb7-4918-b2e8-5f64bc5f0654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:50.051680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6cbbc-9f0e-4c9e-9843-06aa2fc5693c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:50.089606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0a95a-9ec1-44b0-98da-df697404dbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:50.090671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0a95a-9ec1-44b0-98da-df697404dbbe None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:50.091264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0a95a-9ec1-44b0-98da-df697404dbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:50.091803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0a95a-9ec1-44b0-98da-df697404dbbe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.092622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0a95a-9ec1-44b0-98da-df697404dbbe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:50.094527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0a95a-9ec1-44b0-98da-df697404dbbe None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7ca0a95a-9ec1-44b0-98da-df697404dbbe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:50.104984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:50.106237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:23:50.107073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:50.107820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 447/880] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:50.109960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 434/881] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:50.118405 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1357d20-5cb7-4918-b2e8-5f64bc5f0654 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:50.127692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0a95a-9ec1-44b0-98da-df697404dbbe None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:50.128632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:50.221982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:50.241653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1357d20-5cb7-4918-b2e8-5f64bc5f0654 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:50.244630 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0a95a-9ec1-44b0-98da-df697404dbbe None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:50.283166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37df010-9376-4eca-ab03-ee0e50dc6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:50.283655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05139d4-8a41-4d0d-87e9-5fd8d2f3b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:50.284266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05139d4-8a41-4d0d-87e9-5fd8d2f3b851 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:50.284544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05139d4-8a41-4d0d-87e9-5fd8d2f3b851 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:50.284817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05139d4-8a41-4d0d-87e9-5fd8d2f3b851 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.285000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37df010-9376-4eca-ab03-ee0e50dc6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:50.285524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37df010-9376-4eca-ab03-ee0e50dc6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:50.285626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05139d4-8a41-4d0d-87e9-5fd8d2f3b851 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:50.286408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05139d4-8a41-4d0d-87e9-5fd8d2f3b851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:50.286836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37df010-9376-4eca-ab03-ee0e50dc6ea7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.287650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37df010-9376-4eca-ab03-ee0e50dc6ea7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:50.287751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05139d4-8a41-4d0d-87e9-5fd8d2f3b851 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:50.289511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37df010-9376-4eca-ab03-ee0e50dc6ea7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:50.297881 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 448/882] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:50.298712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05139d4-8a41-4d0d-87e9-5fd8d2f3b851 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d37df010-9376-4eca-ab03-ee0e50dc6ea7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:50.299779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:50.300674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:23:50.301616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:50.309306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 435/883] 10.222.0.69 () {56 vars in 1132 bytes} [Thu Aug 4 02:23:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:50.310952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37df010-9376-4eca-ab03-ee0e50dc6ea7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:50.397867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:50.432069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05139d4-8a41-4d0d-87e9-5fd8d2f3b851 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:50.436461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37df010-9376-4eca-ab03-ee0e50dc6ea7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:50.478809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d88f2-1709-4cb2-8f0d-4e2b1b14a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:50.479425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d88f2-1709-4cb2-8f0d-4e2b1b14a457 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:50.479534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b28ddb-9031-4234-b8dc-de70fadee28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:50.479768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d88f2-1709-4cb2-8f0d-4e2b1b14a457 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:50.479974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d88f2-1709-4cb2-8f0d-4e2b1b14a457 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.480083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b28ddb-9031-4234-b8dc-de70fadee28a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:50.480290 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b28ddb-9031-4234-b8dc-de70fadee28a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:50.480562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b28ddb-9031-4234-b8dc-de70fadee28a None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.480660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d88f2-1709-4cb2-8f0d-4e2b1b14a457 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:50.480945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d88f2-1709-4cb2-8f0d-4e2b1b14a457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:50.481224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b28ddb-9031-4234-b8dc-de70fadee28a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:50.481547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b28ddb-9031-4234-b8dc-de70fadee28a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:50.482616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d88f2-1709-4cb2-8f0d-4e2b1b14a457 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:50.482889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b28ddb-9031-4234-b8dc-de70fadee28a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:50.489579 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 436/884] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:23:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:50.494343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 449/885] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:50.498471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d88f2-1709-4cb2-8f0d-4e2b1b14a457 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:50.498643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b28ddb-9031-4234-b8dc-de70fadee28a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:50.511121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:50.619401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d88f2-1709-4cb2-8f0d-4e2b1b14a457 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:50.620152 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b28ddb-9031-4234-b8dc-de70fadee28a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:50.659663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050dedd-242b-401c-a7c7-4f404c236f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:50.660200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050dedd-242b-401c-a7c7-4f404c236f33 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:50.660479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050dedd-242b-401c-a7c7-4f404c236f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:50.661266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050dedd-242b-401c-a7c7-4f404c236f33 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.661976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050dedd-242b-401c-a7c7-4f404c236f33 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:50.662282 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050dedd-242b-401c-a7c7-4f404c236f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:50.663627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050dedd-242b-401c-a7c7-4f404c236f33 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:50.669405 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 450/886] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:23:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:50.673083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e3864-ee93-4b62-942c-3fbaa99216de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:50.674318 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e3864-ee93-4b62-942c-3fbaa99216de None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:50.674779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050dedd-242b-401c-a7c7-4f404c236f33 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:50.675018 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e3864-ee93-4b62-942c-3fbaa99216de None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:50.675502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e3864-ee93-4b62-942c-3fbaa99216de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.677057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e3864-ee93-4b62-942c-3fbaa99216de None admin] RBAC: Adding query filter params (interface=public, service_id=26c255ec27fa413aa5eacd02e4879dbc, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:50.677867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:50.678169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e3864-ee93-4b62-942c-3fbaa99216de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:50.680095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e3864-ee93-4b62-942c-3fbaa99216de None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:50.688546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 437/887] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Aug 4 02:23:50 2022] GET /identity/v3/endpoints?service_id=26c255ec27fa413aa5eacd02e4879dbc&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:50.694241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e3864-ee93-4b62-942c-3fbaa99216de None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:50.788782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050dedd-242b-401c-a7c7-4f404c236f33 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:50.797757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:50.828491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e3864-ee93-4b62-942c-3fbaa99216de None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:50.832210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99c1fc-74d4-41f8-a0f6-c34d9d807ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:50.833452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c1fc-74d4-41f8-a0f6-c34d9d807ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:50.833797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c1fc-74d4-41f8-a0f6-c34d9d807ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:50.834139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c1fc-74d4-41f8-a0f6-c34d9d807ea0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.834964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99c1fc-74d4-41f8-a0f6-c34d9d807ea0 None admin] RBAC: Adding query filter params (interface=public, service_id=c6c1297e22924341bf501d73e7dba446, region_id=RegionOne) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:50.835339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99c1fc-74d4-41f8-a0f6-c34d9d807ea0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:50.837225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99c1fc-74d4-41f8-a0f6-c34d9d807ea0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:50.845529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 451/888] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Aug 4 02:23:50 2022] GET /identity/v3/endpoints?service_id=c6c1297e22924341bf501d73e7dba446&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:50.851161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99c1fc-74d4-41f8-a0f6-c34d9d807ea0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:50.871459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edb849-2301-419a-86ec-13ce999f87cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:50.872074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edb849-2301-419a-86ec-13ce999f87cb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:50.872396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edb849-2301-419a-86ec-13ce999f87cb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:50.872664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edb849-2301-419a-86ec-13ce999f87cb None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:50.873383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edb849-2301-419a-86ec-13ce999f87cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:50.874979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edb849-2301-419a-86ec-13ce999f87cb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:50.881624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 438/889] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Aug 4 02:23:50 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:23:50.935959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:50.975666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99c1fc-74d4-41f8-a0f6-c34d9d807ea0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:51.012048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28176bf-863d-41bb-beb0-1df17f930b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:51.012675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28176bf-863d-41bb-beb0-1df17f930b48 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:51.013008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28176bf-863d-41bb-beb0-1df17f930b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:51.013284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28176bf-863d-41bb-beb0-1df17f930b48 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:51.014020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28176bf-863d-41bb-beb0-1df17f930b48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:51.015506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28176bf-863d-41bb-beb0-1df17f930b48 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:51.023128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 452/890] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Aug 4 02:23:50 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:23:51.424674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcca06-8bf3-4e63-a21e-b969cda11d72 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:51.425026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcca06-8bf3-4e63-a21e-b969cda11d72 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:51.425199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcca06-8bf3-4e63-a21e-b969cda11d72 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:51.427026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 439/891] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:51.432327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ac99-14ee-4bb3-b946-0f433aeeecf3 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:51.432622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ac99-14ee-4bb3-b946-0f433aeeecf3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:51.432895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ac99-14ee-4bb3-b946-0f433aeeecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:51.451714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-04e4ac99-14ee-4bb3-b946-0f433aeeecf3 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:51.452918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-04e4ac99-14ee-4bb3-b946-0f433aeeecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:51.529564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 453/892] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:51.547515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcca06-8bf3-4e63-a21e-b969cda11d72 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:51.664405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcca06-8bf3-4e63-a21e-b969cda11d72 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:51.700132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef314db-4e0f-4325-a62d-7e6fd14a83fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:51.700777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef314db-4e0f-4325-a62d-7e6fd14a83fb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:51.701056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef314db-4e0f-4325-a62d-7e6fd14a83fb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:51.701354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef314db-4e0f-4325-a62d-7e6fd14a83fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:51.704038 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:51.712860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef314db-4e0f-4325-a62d-7e6fd14a83fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-fef314db-4e0f-4325-a62d-7e6fd14a83fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:51.718023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:51.718935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:23:51.719762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:51.724367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 440/893] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Aug 4 02:23:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:51.725736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4ac99-14ee-4bb3-b946-0f433aeeecf3 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:51.770010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23428c1-a825-47b1-aec2-c9e966aaacb1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:51.770316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23428c1-a825-47b1-aec2-c9e966aaacb1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:51.770646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23428c1-a825-47b1-aec2-c9e966aaacb1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:51.772341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 441/894] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:51.778848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb0b0b-87a5-4d98-ae0a-1beb8d534a4b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:51.779128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb0b0b-87a5-4d98-ae0a-1beb8d534a4b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:51.779395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb0b0b-87a5-4d98-ae0a-1beb8d534a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:51.787953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:51.799588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-14fb0b0b-87a5-4d98-ae0a-1beb8d534a4b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:51.800894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-14fb0b0b-87a5-4d98-ae0a-1beb8d534a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:51.831890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4ac99-14ee-4bb3-b946-0f433aeeecf3 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:51.868572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9aa6e-97a7-43cf-9065-69e9e55b4976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:51.869365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9aa6e-97a7-43cf-9065-69e9e55b4976 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:51.869753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9aa6e-97a7-43cf-9065-69e9e55b4976 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:51.870128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9aa6e-97a7-43cf-9065-69e9e55b4976 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:51.870966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9aa6e-97a7-43cf-9065-69e9e55b4976 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:51.871371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9aa6e-97a7-43cf-9065-69e9e55b4976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:51.873043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9aa6e-97a7-43cf-9065-69e9e55b4976 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:51.881790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 442/895] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:23:51.885917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 454/896] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Aug 4 02:23:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:51.886797 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb0b0b-87a5-4d98-ae0a-1beb8d534a4b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:51.900439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9aa6e-97a7-43cf-9065-69e9e55b4976 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:52.013016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb0b0b-87a5-4d98-ae0a-1beb8d534a4b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:52.033667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9aa6e-97a7-43cf-9065-69e9e55b4976 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:52.048379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:52.062052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3546011-e7f6-42af-a5ad-139155697e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:52.062862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3546011-e7f6-42af-a5ad-139155697e87 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:52.063244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3546011-e7f6-42af-a5ad-139155697e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:52.064089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3546011-e7f6-42af-a5ad-139155697e87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:52.067372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:52.079982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3546011-e7f6-42af-a5ad-139155697e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:52.082082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3546011-e7f6-42af-a5ad-139155697e87 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:52.083799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803be57c-9eba-48bb-a1d4-951b7a2da30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:52.084816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803be57c-9eba-48bb-a1d4-951b7a2da30b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:52.085092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803be57c-9eba-48bb-a1d4-951b7a2da30b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:52.085390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803be57c-9eba-48bb-a1d4-951b7a2da30b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:52.086550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803be57c-9eba-48bb-a1d4-951b7a2da30b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:52.088117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803be57c-9eba-48bb-a1d4-951b7a2da30b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-803be57c-9eba-48bb-a1d4-951b7a2da30b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:52.100660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:52.102662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:23:52.104462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-e3546011-e7f6-42af-a5ad-139155697e87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:52.106240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:52.108123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:52.114807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:52.114807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:52.114807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:52.114807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:52.115028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 455/898] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:23:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:52.115028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803be57c-9eba-48bb-a1d4-951b7a2da30b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:52.115165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 443/898] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:52.115165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3546011-e7f6-42af-a5ad-139155697e87 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:52.249438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3546011-e7f6-42af-a5ad-139155697e87 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:52.253784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803be57c-9eba-48bb-a1d4-951b7a2da30b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:52.287907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68557073-72f2-44df-abe9-844806a33ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:52.288798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68557073-72f2-44df-abe9-844806a33ddb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:52.289379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68557073-72f2-44df-abe9-844806a33ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:52.289832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68557073-72f2-44df-abe9-844806a33ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:52.290694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68557073-72f2-44df-abe9-844806a33ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:52.291170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68557073-72f2-44df-abe9-844806a33ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:52.292720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68557073-72f2-44df-abe9-844806a33ddb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:52.298854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ad837-62dc-46b3-9c75-d8a35c5917c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:52.299469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad837-62dc-46b3-9c75-d8a35c5917c0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:52.299751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad837-62dc-46b3-9c75-d8a35c5917c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:52.300024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad837-62dc-46b3-9c75-d8a35c5917c0 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:52.301862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ad837-62dc-46b3-9c75-d8a35c5917c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:52.302180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ad837-62dc-46b3-9c75-d8a35c5917c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:52.304083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ad837-62dc-46b3-9c75-d8a35c5917c0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:52.308021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 444/899] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:52.313769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68557073-72f2-44df-abe9-844806a33ddb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:52.319986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 456/900] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:23:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:52.321498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ad837-62dc-46b3-9c75-d8a35c5917c0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:52.364720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:52.375691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:52.436696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ad837-62dc-46b3-9c75-d8a35c5917c0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:52.452090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68557073-72f2-44df-abe9-844806a33ddb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:52.472539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7782-cc0b-45bf-975e-299b1906e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:52.473850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7782-cc0b-45bf-975e-299b1906e1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:52.474235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7782-cc0b-45bf-975e-299b1906e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:52.474609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7782-cc0b-45bf-975e-299b1906e1d4 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:52.475381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7782-cc0b-45bf-975e-299b1906e1d4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:52.475803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7782-cc0b-45bf-975e-299b1906e1d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:52.477252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7782-cc0b-45bf-975e-299b1906e1d4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:52.489505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 457/901] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:23:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:52.497257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98aac9-9d03-4057-b7e3-30cb628d5872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:52.498212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98aac9-9d03-4057-b7e3-30cb628d5872 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:52.498645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98aac9-9d03-4057-b7e3-30cb628d5872 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:52.499095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98aac9-9d03-4057-b7e3-30cb628d5872 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:52.508100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98aac9-9d03-4057-b7e3-30cb628d5872 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:52.509870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98aac9-9d03-4057-b7e3-30cb628d5872 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7c98aac9-9d03-4057-b7e3-30cb628d5872 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:52.523894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:52.525110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:52.526311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:52.528820 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 445/902] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:23:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:52.535058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7782-cc0b-45bf-975e-299b1906e1d4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:52.651882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7782-cc0b-45bf-975e-299b1906e1d4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:52.667049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:52.688614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5199e8b-ea43-4a82-86fc-e720dba5358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:52.689244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199e8b-ea43-4a82-86fc-e720dba5358a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:52.689561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199e8b-ea43-4a82-86fc-e720dba5358a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:52.689845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199e8b-ea43-4a82-86fc-e720dba5358a None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:52.690649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5199e8b-ea43-4a82-86fc-e720dba5358a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:52.690962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5199e8b-ea43-4a82-86fc-e720dba5358a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:52.693169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5199e8b-ea43-4a82-86fc-e720dba5358a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:52.712592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 458/903] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Aug 4 02:23:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:52.718284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98aac9-9d03-4057-b7e3-30cb628d5872 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:52.822605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:52.826817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98aac9-9d03-4057-b7e3-30cb628d5872 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:52.864484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c66e5-cec7-4ce7-a00a-d69aefd6202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:52.865155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c66e5-cec7-4ce7-a00a-d69aefd6202d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:52.865467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c66e5-cec7-4ce7-a00a-d69aefd6202d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:52.865742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c66e5-cec7-4ce7-a00a-d69aefd6202d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:52.937027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c66e5-cec7-4ce7-a00a-d69aefd6202d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:52.938517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c66e5-cec7-4ce7-a00a-d69aefd6202d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.022530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273b7e-05a6-41f9-9d91-68fc34275b50 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.023049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273b7e-05a6-41f9-9d91-68fc34275b50 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.023141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273b7e-05a6-41f9-9d91-68fc34275b50 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.024427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 459/904] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:53.030626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afc044-f704-493c-846a-c822b1eaa976 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.031220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afc044-f704-493c-846a-c822b1eaa976 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.031590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afc044-f704-493c-846a-c822b1eaa976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.038509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:53.043679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 446/905] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:23:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:23:53.050304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c66e5-cec7-4ce7-a00a-d69aefd6202d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.052989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-88afc044-f704-493c-846a-c822b1eaa976 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:53.054264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-88afc044-f704-493c-846a-c822b1eaa976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:53.147467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 460/906] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:23:53.167056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c66e5-cec7-4ce7-a00a-d69aefd6202d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:53.171227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afc044-f704-493c-846a-c822b1eaa976 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.202802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430734e1-6443-47e9-a559-02d5688816d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:53.203560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430734e1-6443-47e9-a559-02d5688816d7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.203950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430734e1-6443-47e9-a559-02d5688816d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.204288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430734e1-6443-47e9-a559-02d5688816d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.215978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430734e1-6443-47e9-a559-02d5688816d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:53.217443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430734e1-6443-47e9-a559-02d5688816d7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-430734e1-6443-47e9-a559-02d5688816d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:53.232943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:53.233875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:53.234767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:53.234767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:53.234767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:53.234767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:53.234767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 447/907] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:53.235601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52a92-9dd5-4d2b-944f-933c9ac26428 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.235601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52a92-9dd5-4d2b-944f-933c9ac26428 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.235847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52a92-9dd5-4d2b-944f-933c9ac26428 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.237225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 448/908] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:53.242520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df52a92-9dd5-4d2b-944f-933c9ac26428 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.289543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afc044-f704-493c-846a-c822b1eaa976 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:53.291158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:53.298568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:53.326852 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf30a4-7186-4b1c-aee9-9c181162bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:53.327477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf30a4-7186-4b1c-aee9-9c181162bda7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.327926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf30a4-7186-4b1c-aee9-9c181162bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.328060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf30a4-7186-4b1c-aee9-9c181162bda7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.328621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf30a4-7186-4b1c-aee9-9c181162bda7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:53.330025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf30a4-7186-4b1c-aee9-9c181162bda7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-a3cf30a4-7186-4b1c-aee9-9c181162bda7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:53.338783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:53.339744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:53.340594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 461/909] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:53.341412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3d11-cb03-45ba-b94a-87a6d04ea6a1 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.341412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3d11-cb03-45ba-b94a-87a6d04ea6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.341560 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d3d11-cb03-45ba-b94a-87a6d04ea6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.358967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df52a92-9dd5-4d2b-944f-933c9ac26428 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:53.359622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f20d3d11-cb03-45ba-b94a-87a6d04ea6a1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:53.360806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f20d3d11-cb03-45ba-b94a-87a6d04ea6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:53.394144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf59af5-6d9c-4ba4-96c7-d18eb2e9d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:53.394753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf59af5-6d9c-4ba4-96c7-d18eb2e9d6ed None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.395655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf59af5-6d9c-4ba4-96c7-d18eb2e9d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.395938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf59af5-6d9c-4ba4-96c7-d18eb2e9d6ed None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.396619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf59af5-6d9c-4ba4-96c7-d18eb2e9d6ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:53.396956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf59af5-6d9c-4ba4-96c7-d18eb2e9d6ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:53.398399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf59af5-6d9c-4ba4-96c7-d18eb2e9d6ed None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.410263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 449/910] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:53.411577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf59af5-6d9c-4ba4-96c7-d18eb2e9d6ed None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.441051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 462/911] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:53.447092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3d11-cb03-45ba-b94a-87a6d04ea6a1 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.516416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf59af5-6d9c-4ba4-96c7-d18eb2e9d6ed None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:53.527434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:53.548715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:53.555042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d3d11-cb03-45ba-b94a-87a6d04ea6a1 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:53.556118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca34eae-7da1-4448-9c8d-540f28ec1b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:53.556741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca34eae-7da1-4448-9c8d-540f28ec1b33 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.557021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca34eae-7da1-4448-9c8d-540f28ec1b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.557296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca34eae-7da1-4448-9c8d-540f28ec1b33 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.558015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca34eae-7da1-4448-9c8d-540f28ec1b33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:53.558316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca34eae-7da1-4448-9c8d-540f28ec1b33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:53.559678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca34eae-7da1-4448-9c8d-540f28ec1b33 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.569645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 450/912] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:53.569645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca34eae-7da1-4448-9c8d-540f28ec1b33 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.600335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaab37e-f2d1-4bfc-9838-ab54167f431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:53.600975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaab37e-f2d1-4bfc-9838-ab54167f431e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.601254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaab37e-f2d1-4bfc-9838-ab54167f431e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.601560 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaab37e-f2d1-4bfc-9838-ab54167f431e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.608498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaab37e-f2d1-4bfc-9838-ab54167f431e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:53.609995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaab37e-f2d1-4bfc-9838-ab54167f431e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-afaab37e-f2d1-4bfc-9838-ab54167f431e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:53.622125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:53.623122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:53.624030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:53.624030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:53.624030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:53.624030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:53.624030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:53.624030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:53.624030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:53.624030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:53.624030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 463/913] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:53.624515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaab37e-f2d1-4bfc-9838-ab54167f431e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.678569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca34eae-7da1-4448-9c8d-540f28ec1b33 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:53.715521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909f09-3a3e-4ea5-897c-570532820de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:53.716163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909f09-3a3e-4ea5-897c-570532820de5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.716442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909f09-3a3e-4ea5-897c-570532820de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.716720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909f09-3a3e-4ea5-897c-570532820de5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.717358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5909f09-3a3e-4ea5-897c-570532820de5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:53.718730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5909f09-3a3e-4ea5-897c-570532820de5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-b5909f09-3a3e-4ea5-897c-570532820de5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:53.727622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:53.728558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:53.729798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 451/914] 10.222.0.69 () {56 vars in 1132 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:53.730659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909f09-3a3e-4ea5-897c-570532820de5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.737420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaab37e-f2d1-4bfc-9838-ab54167f431e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:53.773201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:53.779718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2893f-bb71-47ed-958f-6864123dbecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:53.780738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2893f-bb71-47ed-958f-6864123dbecc None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.781227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2893f-bb71-47ed-958f-6864123dbecc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.782086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2893f-bb71-47ed-958f-6864123dbecc None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.783252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2893f-bb71-47ed-958f-6864123dbecc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:53.783946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2893f-bb71-47ed-958f-6864123dbecc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:53.785855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2893f-bb71-47ed-958f-6864123dbecc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.795899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 464/915] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:53.795899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2893f-bb71-47ed-958f-6864123dbecc None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.818783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:53.844726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909f09-3a3e-4ea5-897c-570532820de5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:53.879324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb10b-df5f-4357-8784-5a1a03deff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:53.880818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb10b-df5f-4357-8784-5a1a03deff30 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.881116 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb10b-df5f-4357-8784-5a1a03deff30 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.881416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb10b-df5f-4357-8784-5a1a03deff30 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.882167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcb10b-df5f-4357-8784-5a1a03deff30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:53.882466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcb10b-df5f-4357-8784-5a1a03deff30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:53.883896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcb10b-df5f-4357-8784-5a1a03deff30 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.901021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 452/916] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:53.901021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb10b-df5f-4357-8784-5a1a03deff30 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:53.911279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2893f-bb71-47ed-958f-6864123dbecc None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:53.947510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573eca1-2bda-4d9d-9e9e-f8c9690b5e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:53.948121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573eca1-2bda-4d9d-9e9e-f8c9690b5e83 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:53.948409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573eca1-2bda-4d9d-9e9e-f8c9690b5e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:53.948686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573eca1-2bda-4d9d-9e9e-f8c9690b5e83 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:53.949392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573eca1-2bda-4d9d-9e9e-f8c9690b5e83 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:53.949701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573eca1-2bda-4d9d-9e9e-f8c9690b5e83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:53.951081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573eca1-2bda-4d9d-9e9e-f8c9690b5e83 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:53.960355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 465/917] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:53.960355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573eca1-2bda-4d9d-9e9e-f8c9690b5e83 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:54.009941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:54.016279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb10b-df5f-4357-8784-5a1a03deff30 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:54.047826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:54.053606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df51d04-fedd-41e7-82a7-a87a727f7582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:54.054294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51d04-fedd-41e7-82a7-a87a727f7582 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:54.054573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51d04-fedd-41e7-82a7-a87a727f7582 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:54.054852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51d04-fedd-41e7-82a7-a87a727f7582 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:54.055559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df51d04-fedd-41e7-82a7-a87a727f7582 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:54.056921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df51d04-fedd-41e7-82a7-a87a727f7582 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:54.064715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573eca1-2bda-4d9d-9e9e-f8c9690b5e83 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:54.085359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 453/918] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:23:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:54.085359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df51d04-fedd-41e7-82a7-a87a727f7582 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:54.118222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516c6b-a936-4c21-beba-7a78e8f50a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:54.119080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516c6b-a936-4c21-beba-7a78e8f50a94 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:54.119399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516c6b-a936-4c21-beba-7a78e8f50a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:54.119744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9516c6b-a936-4c21-beba-7a78e8f50a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:54.120657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9516c6b-a936-4c21-beba-7a78e8f50a94 None admin] RBAC: Adding query filter params (role.id=0d7c035be92f4ed4bdc212b1ed9a8fce, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=758a5ce9caf046929eec499e6afc1dd8) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:54.121045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9516c6b-a936-4c21-beba-7a78e8f50a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:54.122696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9516c6b-a936-4c21-beba-7a78e8f50a94 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:54.129580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 466/919] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:23:53 2022] GET /identity/v3/role_assignments?user.id=758a5ce9caf046929eec499e6afc1dd8&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=0d7c035be92f4ed4bdc212b1ed9a8fce => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:54.220725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df51d04-fedd-41e7-82a7-a87a727f7582 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:54.263224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0ec9-4f7d-4977-947e-a4d51e6b9f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:54.263941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0ec9-4f7d-4977-947e-a4d51e6b9f57 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:54.264411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0ec9-4f7d-4977-947e-a4d51e6b9f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:54.264699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0ec9-4f7d-4977-947e-a4d51e6b9f57 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:54.265442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f0ec9-4f7d-4977-947e-a4d51e6b9f57 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:54.265812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f0ec9-4f7d-4977-947e-a4d51e6b9f57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:54.267283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f0ec9-4f7d-4977-947e-a4d51e6b9f57 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:54.274302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 454/920] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:23:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:54.280062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516c6b-a936-4c21-beba-7a78e8f50a94 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:54.394094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9516c6b-a936-4c21-beba-7a78e8f50a94 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:54.429202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4c2b5-dea8-4f41-b9e3-302dc3eb240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:54.429894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4c2b5-dea8-4f41-b9e3-302dc3eb240a None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:54.430175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4c2b5-dea8-4f41-b9e3-302dc3eb240a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:54.430503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4c2b5-dea8-4f41-b9e3-302dc3eb240a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:54.431225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4c2b5-dea8-4f41-b9e3-302dc3eb240a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:54.432576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4c2b5-dea8-4f41-b9e3-302dc3eb240a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:54.450837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:54.461559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 467/921] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:23:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:54.534001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef078a-b547-40b7-a3a8-79bb27a306d3 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:54.534176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef078a-b547-40b7-a3a8-79bb27a306d3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:54.534457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef078a-b547-40b7-a3a8-79bb27a306d3 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:54.536192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 455/922] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:54.541800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a64bd-25a5-47c8-88f9-7cda596efa74 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:54.542139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a64bd-25a5-47c8-88f9-7cda596efa74 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:54.542486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a64bd-25a5-47c8-88f9-7cda596efa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:54.565993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-535a64bd-25a5-47c8-88f9-7cda596efa74 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:54.567849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-535a64bd-25a5-47c8-88f9-7cda596efa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:54.648120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 468/923] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:54.671947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef078a-b547-40b7-a3a8-79bb27a306d3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:54.693574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:54.780648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef078a-b547-40b7-a3a8-79bb27a306d3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:54.814813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a1aaf-1ddb-4b0a-bc72-ee1147863964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:54.815353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a1aaf-1ddb-4b0a-bc72-ee1147863964 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:54.815627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a1aaf-1ddb-4b0a-bc72-ee1147863964 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:54.815895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a1aaf-1ddb-4b0a-bc72-ee1147863964 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:54.816594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a1aaf-1ddb-4b0a-bc72-ee1147863964 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:54.818503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a1aaf-1ddb-4b0a-bc72-ee1147863964 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:54.839622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 456/924] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:23:54 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:23:56.240226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df19c7-6035-482d-9dec-c78f8476ddff None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.240874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df19c7-6035-482d-9dec-c78f8476ddff None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.240874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df19c7-6035-482d-9dec-c78f8476ddff None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.242416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 469/925] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:56.247470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99889e6f-8362-49cb-b26b-b73a79ab63a1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.247878 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99889e6f-8362-49cb-b26b-b73a79ab63a1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.248068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99889e6f-8362-49cb-b26b-b73a79ab63a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.268047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-99889e6f-8362-49cb-b26b-b73a79ab63a1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:56.269730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ffb6a-6eb9-4245-8aa3-b42d87c541cc None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.270584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ffb6a-6eb9-4245-8aa3-b42d87c541cc None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.270875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ffb6a-6eb9-4245-8aa3-b42d87c541cc None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.271673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-99889e6f-8362-49cb-b26b-b73a79ab63a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:56.272535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 470/926] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:23:56.278614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93467c-b970-44c9-b3f0-35b318edec8d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.279006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93467c-b970-44c9-b3f0-35b318edec8d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.279376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93467c-b970-44c9-b3f0-35b318edec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.297980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ca93467c-b970-44c9-b3f0-35b318edec8d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:56.299304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ca93467c-b970-44c9-b3f0-35b318edec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:56.355431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 457/927] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:56.380201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 471/928] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:23:56.383659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99889e6f-8362-49cb-b26b-b73a79ab63a1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:56.386730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:56.405426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93467c-b970-44c9-b3f0-35b318edec8d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:56.477437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:56.512608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99889e6f-8362-49cb-b26b-b73a79ab63a1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:56.534432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93467c-b970-44c9-b3f0-35b318edec8d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:56.560123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd505cdb-fdf5-4b4b-9c7e-ada27a04b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:56.561204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd505cdb-fdf5-4b4b-9c7e-ada27a04b3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.561845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd505cdb-fdf5-4b4b-9c7e-ada27a04b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.562144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd505cdb-fdf5-4b4b-9c7e-ada27a04b3e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.575722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c1e7e-52a0-43f5-940b-b18f6f5097bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:56.576493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c1e7e-52a0-43f5-940b-b18f6f5097bc None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.576769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c1e7e-52a0-43f5-940b-b18f6f5097bc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.576877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd505cdb-fdf5-4b4b-9c7e-ada27a04b3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:23:56.577056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c1e7e-52a0-43f5-940b-b18f6f5097bc None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.577739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c1e7e-52a0-43f5-940b-b18f6f5097bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:56.579167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c1e7e-52a0-43f5-940b-b18f6f5097bc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:56.581788 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WARNING keystone.server.flask.common [None req-431c1e7e-52a0-43f5-940b-b18f6f5097bc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-bd505cdb-fdf5-4b4b-9c7e-ada27a04b3e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:23:56.581902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:56.583417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:56.584309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 458/929] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Aug 4 02:23:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:56.585626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d90c77-fcee-40b2-aba4-20d2781033b7 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.585626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d90c77-fcee-40b2-aba4-20d2781033b7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.585929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d90c77-fcee-40b2-aba4-20d2781033b7 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.589365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 459/930] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:56.590654 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d90c77-fcee-40b2-aba4-20d2781033b7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:56.605931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.sql.core [None req-431c1e7e-52a0-43f5-940b-b18f6f5097bc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 02:23:56.605931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 02:23:56.605931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [parameters: {'id': 'bc190590a7814c10bbb9335557abd23f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 02:23:56.605931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80480) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-431c1e7e-52a0-43f5-940b-b18f6f5097bc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc190590a7814c10bbb9335557abd23f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc190590a7814c10bbb9335557abd23f. Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:23:56.613321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application result.read() Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 02:23:56.614846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application yield resource Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise self.value Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application session.commit() Aug 04 02:23:56.615876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.session.flush() Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application compat.raise_( Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 02:23:56.616753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 02:23:56.617679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application result.read() Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:23:56.618463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [parameters: {'id': 'bc190590a7814c10bbb9335557abd23f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:56.619330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:56.620411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc190590a7814c10bbb9335557abd23f. Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 472/931] 10.222.0.69 () {60 vars in 1140 bytes} [Thu Aug 4 02:23:56 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7217f-a39e-48cd-9214-b0d41154d618 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.621531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7217f-a39e-48cd-9214-b0d41154d618 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.622488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7217f-a39e-48cd-9214-b0d41154d618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.637520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-d3b7217f-a39e-48cd-9214-b0d41154d618 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:56.639021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d3b7217f-a39e-48cd-9214-b0d41154d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:56.671751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:56.712533 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 473/932] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:56.713205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7217f-a39e-48cd-9214-b0d41154d618 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:56.725191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d90c77-fcee-40b2-aba4-20d2781033b7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:56.761982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:56.765609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f82d-918e-4c23-a074-4b530440ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:56.766573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f82d-918e-4c23-a074-4b530440ef1c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.767285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f82d-918e-4c23-a074-4b530440ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.767285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434f82d-918e-4c23-a074-4b530440ef1c None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.768016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434f82d-918e-4c23-a074-4b530440ef1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:56.768313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434f82d-918e-4c23-a074-4b530440ef1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:56.769693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434f82d-918e-4c23-a074-4b530440ef1c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:56.778828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 460/933] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Aug 4 02:23:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:56.779616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f82d-918e-4c23-a074-4b530440ef1c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:56.830265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7217f-a39e-48cd-9214-b0d41154d618 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:56.868011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1bd59-9cf6-4af4-a7bb-0784ab967381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:56.868761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1bd59-9cf6-4af4-a7bb-0784ab967381 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.869038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1bd59-9cf6-4af4-a7bb-0784ab967381 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.869457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1bd59-9cf6-4af4-a7bb-0784ab967381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.876539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1bd59-9cf6-4af4-a7bb-0784ab967381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:56.878318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1bd59-9cf6-4af4-a7bb-0784ab967381 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:56.887347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434f82d-918e-4c23-a074-4b530440ef1c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-57d1bd59-9cf6-4af4-a7bb-0784ab967381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:56.890850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:56.891747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 474/934] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:56.897201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1bd59-9cf6-4af4-a7bb-0784ab967381 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:56.915068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:56.924433 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4b9bb-201d-42df-97fc-40e9355bf911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:56.925065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4b9bb-201d-42df-97fc-40e9355bf911 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.925357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4b9bb-201d-42df-97fc-40e9355bf911 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.925651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4b9bb-201d-42df-97fc-40e9355bf911 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.926803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4b9bb-201d-42df-97fc-40e9355bf911 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:56.928154 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4b9bb-201d-42df-97fc-40e9355bf911 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-bda4b9bb-201d-42df-97fc-40e9355bf911 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:56.936955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:56.938070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:56.938911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 461/935] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:56.939715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9107c-2a16-42e4-9bda-4f79ade5788c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:56.940555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9107c-2a16-42e4-9bda-4f79ade5788c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:56.940555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9107c-2a16-42e4-9bda-4f79ade5788c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:56.941577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 462/936] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:56.942713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9107c-2a16-42e4-9bda-4f79ade5788c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:56.997243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1bd59-9cf6-4af4-a7bb-0784ab967381 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:56.998758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:57.031941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24b36-47b0-467f-86b6-8c36c09d5a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.032505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24b36-47b0-467f-86b6-8c36c09d5a1d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.032787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24b36-47b0-467f-86b6-8c36c09d5a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.033062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24b36-47b0-467f-86b6-8c36c09d5a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.042967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba24b36-47b0-467f-86b6-8c36c09d5a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.044391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba24b36-47b0-467f-86b6-8c36c09d5a1d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.045414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9107c-2a16-42e4-9bda-4f79ade5788c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-2ba24b36-47b0-467f-86b6-8c36c09d5a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:57.059373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:57.060457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:57.061361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:57.061361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:57.061361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:57.061361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:57.061361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 475/937] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:57.061361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24b36-47b0-467f-86b6-8c36c09d5a1d None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.083248 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5fe2-8f0b-46ae-b155-879ae7176ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.083864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5fe2-8f0b-46ae-b155-879ae7176ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.084147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5fe2-8f0b-46ae-b155-879ae7176ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.084417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5fe2-8f0b-46ae-b155-879ae7176ca4 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.085130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5fe2-8f0b-46ae-b155-879ae7176ca4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:57.085463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5fe2-8f0b-46ae-b155-879ae7176ca4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.086879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5fe2-8f0b-46ae-b155-879ae7176ca4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.103923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 463/938] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:23:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:57.105238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626c01-9920-404b-94af-9801844af3d5 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.105560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626c01-9920-404b-94af-9801844af3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.105840 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626c01-9920-404b-94af-9801844af3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.125718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-73626c01-9920-404b-94af-9801844af3d5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:57.126943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-73626c01-9920-404b-94af-9801844af3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:57.181387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:57.181896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24b36-47b0-467f-86b6-8c36c09d5a1d None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.205163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 464/939] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:57.205947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73626c01-9920-404b-94af-9801844af3d5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.221111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3b21e-1bd8-4b65-b0b9-8de3f92a300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.222170 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3b21e-1bd8-4b65-b0b9-8de3f92a300c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.222677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3b21e-1bd8-4b65-b0b9-8de3f92a300c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.223701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3b21e-1bd8-4b65-b0b9-8de3f92a300c None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.224625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3b21e-1bd8-4b65-b0b9-8de3f92a300c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:57.225138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3b21e-1bd8-4b65-b0b9-8de3f92a300c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.226892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3b21e-1bd8-4b65-b0b9-8de3f92a300c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.235897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 476/940] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:57.236756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3b21e-1bd8-4b65-b0b9-8de3f92a300c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.263312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:57.333398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73626c01-9920-404b-94af-9801844af3d5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.356866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3b21e-1bd8-4b65-b0b9-8de3f92a300c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.371343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d82a4-ed26-4b7d-bdd3-9107e05ef265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.371967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d82a4-ed26-4b7d-bdd3-9107e05ef265 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.372246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d82a4-ed26-4b7d-bdd3-9107e05ef265 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.372548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d82a4-ed26-4b7d-bdd3-9107e05ef265 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.373200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d82a4-ed26-4b7d-bdd3-9107e05ef265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:57.373522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d82a4-ed26-4b7d-bdd3-9107e05ef265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.374893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d82a4-ed26-4b7d-bdd3-9107e05ef265 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.387357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 465/941] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:57.388152 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d82a4-ed26-4b7d-bdd3-9107e05ef265 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.396162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fc175-c807-452e-bfd5-4ca7f5d120c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.396809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fc175-c807-452e-bfd5-4ca7f5d120c2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.397088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fc175-c807-452e-bfd5-4ca7f5d120c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.397393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fc175-c807-452e-bfd5-4ca7f5d120c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.398500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fc175-c807-452e-bfd5-4ca7f5d120c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.400252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fc175-c807-452e-bfd5-4ca7f5d120c2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-484fc175-c807-452e-bfd5-4ca7f5d120c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:57.411001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:57.412023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:57.412848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 477/942] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:57.413674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fc175-c807-452e-bfd5-4ca7f5d120c2 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.439710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:57.497419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:57.506362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d82a4-ed26-4b7d-bdd3-9107e05ef265 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.516986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fc175-c807-452e-bfd5-4ca7f5d120c2 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.549670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcceb6e-0f06-48a4-9e3a-23e951248f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.550546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcceb6e-0f06-48a4-9e3a-23e951248f00 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.551005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcceb6e-0f06-48a4-9e3a-23e951248f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.551564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ecdb-83af-4629-9ff3-75041aee93b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.551722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcceb6e-0f06-48a4-9e3a-23e951248f00 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.552201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ecdb-83af-4629-9ff3-75041aee93b2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.552482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ecdb-83af-4629-9ff3-75041aee93b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.552757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ecdb-83af-4629-9ff3-75041aee93b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.553107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcceb6e-0f06-48a4-9e3a-23e951248f00 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:57.553606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcceb6e-0f06-48a4-9e3a-23e951248f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.555131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcceb6e-0f06-48a4-9e3a-23e951248f00 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.560736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 466/943] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:57.561992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcceb6e-0f06-48a4-9e3a-23e951248f00 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.562346 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296ecdb-83af-4629-9ff3-75041aee93b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.563946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296ecdb-83af-4629-9ff3-75041aee93b2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d296ecdb-83af-4629-9ff3-75041aee93b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:57.578091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:57.579158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:57.580486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 478/944] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:57.585731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ecdb-83af-4629-9ff3-75041aee93b2 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.704950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ecdb-83af-4629-9ff3-75041aee93b2 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.705690 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcceb6e-0f06-48a4-9e3a-23e951248f00 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.711051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:57.748128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fcc35-5fd5-4982-9663-483dfe8dbdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.749097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fcc35-5fd5-4982-9663-483dfe8dbdaa None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.749595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fcc35-5fd5-4982-9663-483dfe8dbdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.750014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fcc35-5fd5-4982-9663-483dfe8dbdaa None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.750965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fcc35-5fd5-4982-9663-483dfe8dbdaa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:57.751431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fcc35-5fd5-4982-9663-483dfe8dbdaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.752996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fcc35-5fd5-4982-9663-483dfe8dbdaa None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.756697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a61bab-fb62-4cba-b277-d7bb4100c78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.758653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a61bab-fb62-4cba-b277-d7bb4100c78f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.758653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a61bab-fb62-4cba-b277-d7bb4100c78f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.759043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a61bab-fb62-4cba-b277-d7bb4100c78f None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.759822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a61bab-fb62-4cba-b277-d7bb4100c78f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:57.760224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a61bab-fb62-4cba-b277-d7bb4100c78f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.761708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a61bab-fb62-4cba-b277-d7bb4100c78f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.768565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 467/945] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:57.772221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:57.775581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a61bab-fb62-4cba-b277-d7bb4100c78f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.778856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 479/946] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:57.786079 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fcc35-5fd5-4982-9663-483dfe8dbdaa None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.900481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a61bab-fb62-4cba-b277-d7bb4100c78f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.933000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fcc35-5fd5-4982-9663-483dfe8dbdaa None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:57.944390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa76d38-b226-44c5-a028-5aa0c62470fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.945103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa76d38-b226-44c5-a028-5aa0c62470fa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.945421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa76d38-b226-44c5-a028-5aa0c62470fa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.945696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa76d38-b226-44c5-a028-5aa0c62470fa None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:57.946385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa76d38-b226-44c5-a028-5aa0c62470fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:57.947106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa76d38-b226-44c5-a028-5aa0c62470fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:57.948981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa76d38-b226-44c5-a028-5aa0c62470fa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:57.954970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 468/947] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:57.961352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa76d38-b226-44c5-a028-5aa0c62470fa None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:57.986209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f468ca-c980-4f10-85fa-695a21c08c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:57.986850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f468ca-c980-4f10-85fa-695a21c08c4f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:57.987129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f468ca-c980-4f10-85fa-695a21c08c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:57.987402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f468ca-c980-4f10-85fa-695a21c08c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:58.001388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:58.001593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f468ca-c980-4f10-85fa-695a21c08c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:58.003849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f468ca-c980-4f10-85fa-695a21c08c4f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-51f468ca-c980-4f10-85fa-695a21c08c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:23:58.025410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:58.026320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:58.027192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:23:58.027192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:23:58.027192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:23:58.027192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:58.032053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 480/948] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:58.033016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f468ca-c980-4f10-85fa-695a21c08c4f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:58.095104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa76d38-b226-44c5-a028-5aa0c62470fa None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:58.107188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:58.132995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5d727-1938-499f-9c4a-e297cd196dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:58.133987 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5d727-1938-499f-9c4a-e297cd196dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:58.134485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5d727-1938-499f-9c4a-e297cd196dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:58.135031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5d727-1938-499f-9c4a-e297cd196dc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:58.135972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5d727-1938-499f-9c4a-e297cd196dc9 None admin] RBAC: Adding query filter params (interface=public, service_id=ccf1acba39c143c2b65c8b622f13a8be, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:58.136469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5d727-1938-499f-9c4a-e297cd196dc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:58.138143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5d727-1938-499f-9c4a-e297cd196dc9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:58.147453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 469/949] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Aug 4 02:23:57 2022] GET /identity/v3/endpoints?service_id=ccf1acba39c143c2b65c8b622f13a8be&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:58.154551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5d727-1938-499f-9c4a-e297cd196dc9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:58.170408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f468ca-c980-4f10-85fa-695a21c08c4f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:58.217913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850881ea-ce3b-4ee1-af1b-674dfda9abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:58.219157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850881ea-ce3b-4ee1-af1b-674dfda9abd1 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:58.219886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850881ea-ce3b-4ee1-af1b-674dfda9abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:58.220759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850881ea-ce3b-4ee1-af1b-674dfda9abd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:58.221981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850881ea-ce3b-4ee1-af1b-674dfda9abd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:58.222491 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850881ea-ce3b-4ee1-af1b-674dfda9abd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:58.224950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850881ea-ce3b-4ee1-af1b-674dfda9abd1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:58.244780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 481/950] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:58.250617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850881ea-ce3b-4ee1-af1b-674dfda9abd1 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:58.263190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:58.271882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5d727-1938-499f-9c4a-e297cd196dc9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:58.323139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ac08a-a9ea-483a-b4bc-1e6fd42a50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:58.323849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac08a-a9ea-483a-b4bc-1e6fd42a50cc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:58.324133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac08a-a9ea-483a-b4bc-1e6fd42a50cc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:58.324406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac08a-a9ea-483a-b4bc-1e6fd42a50cc None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:58.325058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ac08a-a9ea-483a-b4bc-1e6fd42a50cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:58.327143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ac08a-a9ea-483a-b4bc-1e6fd42a50cc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:58.335808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 470/951] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Aug 4 02:23:58 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:23:58.378729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850881ea-ce3b-4ee1-af1b-674dfda9abd1 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:58.396097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:58.420761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ab141-a9ac-4ce0-b884-7301cf8c12b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:58.421874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ab141-a9ac-4ce0-b884-7301cf8c12b1 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:58.422404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ab141-a9ac-4ce0-b884-7301cf8c12b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:58.422859 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ab141-a9ac-4ce0-b884-7301cf8c12b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:58.431731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ab141-a9ac-4ce0-b884-7301cf8c12b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:58.433554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ab141-a9ac-4ce0-b884-7301cf8c12b1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-222ab141-a9ac-4ce0-b884-7301cf8c12b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:23:58.447012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:58.447964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:58.448848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:23:58.448848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:23:58.448848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:23:58.448848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:23:58.448848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:23:58.448848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:23:58.448848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:23:58.448848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:58.450930 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 482/952] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:23:58.456975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ac08a-a9ea-483a-b4bc-1e6fd42a50cc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:58.569777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ac08a-a9ea-483a-b4bc-1e6fd42a50cc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:58.605315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1049d9-d43b-48bc-8030-60875a50b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:58.605955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1049d9-d43b-48bc-8030-60875a50b30c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:58.606235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1049d9-d43b-48bc-8030-60875a50b30c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:58.606505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1049d9-d43b-48bc-8030-60875a50b30c None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:58.607313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1049d9-d43b-48bc-8030-60875a50b30c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:58.607622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1049d9-d43b-48bc-8030-60875a50b30c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:58.609049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1049d9-d43b-48bc-8030-60875a50b30c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:58.623562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 471/953] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:23:58.629402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ab141-a9ac-4ce0-b884-7301cf8c12b1 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:58.735247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ab141-a9ac-4ce0-b884-7301cf8c12b1 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:58.774134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30a0de-3bf2-4ed2-bc00-60c79402aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:58.775194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30a0de-3bf2-4ed2-bc00-60c79402aebf None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:58.775686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30a0de-3bf2-4ed2-bc00-60c79402aebf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:58.776164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30a0de-3bf2-4ed2-bc00-60c79402aebf None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/758a5ce9caf046929eec499e6afc1dd8/roles/0d7c035be92f4ed4bdc212b1ed9a8fce` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:58.778887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30a0de-3bf2-4ed2-bc00-60c79402aebf None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=758a5ce9caf046929eec499e6afc1dd8, role_id=0d7c035be92f4ed4bdc212b1ed9a8fce)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:58.780521 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30a0de-3bf2-4ed2-bc00-60c79402aebf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:58.799682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 483/954] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:23:58 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/758a5ce9caf046929eec499e6afc1dd8/roles/0d7c035be92f4ed4bdc212b1ed9a8fce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:23:59.216016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bcb1c-6215-4508-a190-c2ff4a82b747 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:59.216416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bcb1c-6215-4508-a190-c2ff4a82b747 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:59.216555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bcb1c-6215-4508-a190-c2ff4a82b747 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:59.218236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 472/955] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:59.223926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ecc7d-f11e-4195-b6e4-fbdf6fd27d0c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:59.224214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ecc7d-f11e-4195-b6e4-fbdf6fd27d0c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:59.224490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ecc7d-f11e-4195-b6e4-fbdf6fd27d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:59.243521 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-eb1ecc7d-f11e-4195-b6e4-fbdf6fd27d0c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:59.244707 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-eb1ecc7d-f11e-4195-b6e4-fbdf6fd27d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:59.274184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:59.324865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 484/956] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:23:59.349276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bcb1c-6215-4508-a190-c2ff4a82b747 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:59.373475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:59.462334 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bcb1c-6215-4508-a190-c2ff4a82b747 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:59.499838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813f165-c1f6-4f2a-8200-c92ae1bd97a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:59.500834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813f165-c1f6-4f2a-8200-c92ae1bd97a0 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:59.501317 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813f165-c1f6-4f2a-8200-c92ae1bd97a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:59.501868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813f165-c1f6-4f2a-8200-c92ae1bd97a0 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:59.502778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813f165-c1f6-4f2a-8200-c92ae1bd97a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:59.504464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813f165-c1f6-4f2a-8200-c92ae1bd97a0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:59.507511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING keystone.server.flask.common [None req-6813f165-c1f6-4f2a-8200-c92ae1bd97a0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 02:23:59.521947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.sql.core [None req-6813f165-c1f6-4f2a-8200-c92ae1bd97a0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 02:23:59.521947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 02:23:59.521947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [parameters: {'user_id': 'b58812ef185f4d099f1b73854d8f4fac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 02:23:59.521947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-6813f165-c1f6-4f2a-8200-c92ae1bd97a0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application result.read() Aug 04 02:23:59.540650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:23:59.541641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application yield resource Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application next(self.gen) Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise self.value Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application session.commit() Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 02:23:59.542644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.session.flush() Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application compat.raise_( Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 02:23:59.543575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 02:23:59.545428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application conn.query(q) Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application result.read() Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 02:23:59.547521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b58812ef185f4d099f1b73854d8f4fac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:59.549641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 02:23:59.552269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 02:23:59.556124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 02:23:59.556124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 02:23:59.556124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 02:23:59.556124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 02:23:59.556124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 02:23:59.556124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:23:59.557292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 473/957] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Aug 4 02:23:59 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:59.565981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ecc7d-f11e-4195-b6e4-fbdf6fd27d0c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:59.659592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb426f-e799-4f7a-9199-c73db134be2a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:59.660075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb426f-e799-4f7a-9199-c73db134be2a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:59.661038 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb426f-e799-4f7a-9199-c73db134be2a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:59.669664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 474/958] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:23:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:23:59.670339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ecc7d-f11e-4195-b6e4-fbdf6fd27d0c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:59.671323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef933b52-149d-4680-9392-bb5bf5d164ec None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:59.671703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef933b52-149d-4680-9392-bb5bf5d164ec None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:59.672168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef933b52-149d-4680-9392-bb5bf5d164ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:59.695613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ef933b52-149d-4680-9392-bb5bf5d164ec None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:23:59.697879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ef933b52-149d-4680-9392-bb5bf5d164ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:23:59.717201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f82d3-0515-42e4-bfdb-592f151fbdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:59.717874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f82d3-0515-42e4-bfdb-592f151fbdfa None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:59.718414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f82d3-0515-42e4-bfdb-592f151fbdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:59.718694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f82d3-0515-42e4-bfdb-592f151fbdfa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:59.728631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f82d3-0515-42e4-bfdb-592f151fbdfa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:59.730747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f82d3-0515-42e4-bfdb-592f151fbdfa None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d61f82d3-0515-42e4-bfdb-592f151fbdfa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:23:59.747238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:23:59.748237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:23:59.749200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 485/959] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:23:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:23:59.752702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f82d3-0515-42e4-bfdb-592f151fbdfa None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:59.789445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 475/960] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:23:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:23:59.789819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:59.806398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef933b52-149d-4680-9392-bb5bf5d164ec None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:23:59.822203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:23:59.865706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f82d3-0515-42e4-bfdb-592f151fbdfa None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:59.901123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b2e9f-57a0-4cdc-92d9-bfb24131123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:59.901878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2e9f-57a0-4cdc-92d9-bfb24131123d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:59.902223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2e9f-57a0-4cdc-92d9-bfb24131123d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:59.902554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2e9f-57a0-4cdc-92d9-bfb24131123d None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:59.903579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b2e9f-57a0-4cdc-92d9-bfb24131123d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:23:59.903883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b2e9f-57a0-4cdc-92d9-bfb24131123d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:59.905312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b2e9f-57a0-4cdc-92d9-bfb24131123d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:59.917220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef933b52-149d-4680-9392-bb5bf5d164ec None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:23:59.942541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 486/961] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Aug 4 02:23:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:23:59.959576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2410ed-78bf-45dd-a0ea-a5da3ab3369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:23:59.960531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2410ed-78bf-45dd-a0ea-a5da3ab3369d None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:23:59.960980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2410ed-78bf-45dd-a0ea-a5da3ab3369d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:23:59.961451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2410ed-78bf-45dd-a0ea-a5da3ab3369d None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:23:59.962333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2410ed-78bf-45dd-a0ea-a5da3ab3369d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:23:59.964119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2410ed-78bf-45dd-a0ea-a5da3ab3369d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:23:59.993281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 476/962] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:23:59 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:24:00.464068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43ec97-a576-4f00-81b3-2f03d3ee4273 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:00.464477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43ec97-a576-4f00-81b3-2f03d3ee4273 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:00.464761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43ec97-a576-4f00-81b3-2f03d3ee4273 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:00.466180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 487/963] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:00.471699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cd287-3df6-471a-9f70-1a26c6eb859f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:00.472154 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cd287-3df6-471a-9f70-1a26c6eb859f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:00.472233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cd287-3df6-471a-9f70-1a26c6eb859f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:00.490836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-261cd287-3df6-471a-9f70-1a26c6eb859f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:00.492215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-261cd287-3df6-471a-9f70-1a26c6eb859f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:00.564188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:00.577478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 477/964] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:00.597303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43ec97-a576-4f00-81b3-2f03d3ee4273 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:00.683692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:00.705487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43ec97-a576-4f00-81b3-2f03d3ee4273 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:00.741607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf024f-6e7c-41eb-8861-843a781d1757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:00.742165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf024f-6e7c-41eb-8861-843a781d1757 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:00.742443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf024f-6e7c-41eb-8861-843a781d1757 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:00.742716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf024f-6e7c-41eb-8861-843a781d1757 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:00.743342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf024f-6e7c-41eb-8861-843a781d1757 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:00.744704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf024f-6e7c-41eb-8861-843a781d1757 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-8acf024f-6e7c-41eb-8861-843a781d1757 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:00.753625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:00.755335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:00.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 488/965] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:24:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:00.763070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cd287-3df6-471a-9f70-1a26c6eb859f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:00.862638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cd287-3df6-471a-9f70-1a26c6eb859f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:00.871330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4f763-c79f-4dc1-a41b-3e67c7cfc889 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:00.871659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4f763-c79f-4dc1-a41b-3e67c7cfc889 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:00.871882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4f763-c79f-4dc1-a41b-3e67c7cfc889 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:00.873366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 489/966] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:24:00.877822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498bd55-de51-4e04-925e-7fafc8f2f2ce None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:00.878103 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498bd55-de51-4e04-925e-7fafc8f2f2ce None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:00.878377 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498bd55-de51-4e04-925e-7fafc8f2f2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:00.896109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b498bd55-de51-4e04-925e-7fafc8f2f2ce None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:00.897281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b498bd55-de51-4e04-925e-7fafc8f2f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:00.897578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9706-e729-438e-adb9-67490e32d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:00.898191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9706-e729-438e-adb9-67490e32d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:00.898473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9706-e729-438e-adb9-67490e32d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:00.898747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9706-e729-438e-adb9-67490e32d1c8 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:00.899423 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a9706-e729-438e-adb9-67490e32d1c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:00.899724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a9706-e729-438e-adb9-67490e32d1c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:00.901107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a9706-e729-438e-adb9-67490e32d1c8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:00.906734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 478/967] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:24:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:00.912713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9706-e729-438e-adb9-67490e32d1c8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:00.977095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 490/968] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:00.978891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:00.998878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498bd55-de51-4e04-925e-7fafc8f2f2ce None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:01.019135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9706-e729-438e-adb9-67490e32d1c8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:01.057249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d85dc-c37f-41f8-bc6f-4f9000f85555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:01.057890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d85dc-c37f-41f8-bc6f-4f9000f85555 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:01.058169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d85dc-c37f-41f8-bc6f-4f9000f85555 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:01.058438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d85dc-c37f-41f8-bc6f-4f9000f85555 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:01.059102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d85dc-c37f-41f8-bc6f-4f9000f85555 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:01.059399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d85dc-c37f-41f8-bc6f-4f9000f85555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:01.060783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d85dc-c37f-41f8-bc6f-4f9000f85555 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:01.066168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 479/969] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:24:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:01.072022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d85dc-c37f-41f8-bc6f-4f9000f85555 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:01.080160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:01.107263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498bd55-de51-4e04-925e-7fafc8f2f2ce None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:01.147964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cb9e3-df46-4c58-9946-41c94d599f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:01.148605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cb9e3-df46-4c58-9946-41c94d599f80 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:01.148884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cb9e3-df46-4c58-9946-41c94d599f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:01.149156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cb9e3-df46-4c58-9946-41c94d599f80 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:01.159832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cb9e3-df46-4c58-9946-41c94d599f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-6d4cb9e3-df46-4c58-9946-41c94d599f80 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:01.165575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:01.166759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:24:01.167767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:01.171508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 491/970] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Aug 4 02:24:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:01.172735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cb9e3-df46-4c58-9946-41c94d599f80 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:01.182990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d85dc-c37f-41f8-bc6f-4f9000f85555 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:01.210994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:01.220082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8d681-5df5-4404-a0d3-a6d7313b9136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:01.220697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d681-5df5-4404-a0d3-a6d7313b9136 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:01.220977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d681-5df5-4404-a0d3-a6d7313b9136 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:01.221288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8d681-5df5-4404-a0d3-a6d7313b9136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:01.221980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8d681-5df5-4404-a0d3-a6d7313b9136 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:01.223952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8d681-5df5-4404-a0d3-a6d7313b9136 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:01.245423 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 480/971] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:24:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:24:01.286645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cb9e3-df46-4c58-9946-41c94d599f80 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:01.324705 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:01.332927 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841ab2b-d01e-4077-8a0c-8ef397b751b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:01.333578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841ab2b-d01e-4077-8a0c-8ef397b751b6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:01.333857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841ab2b-d01e-4077-8a0c-8ef397b751b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:01.334129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841ab2b-d01e-4077-8a0c-8ef397b751b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:01.334845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841ab2b-d01e-4077-8a0c-8ef397b751b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:01.335144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841ab2b-d01e-4077-8a0c-8ef397b751b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:01.336519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841ab2b-d01e-4077-8a0c-8ef397b751b6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:01.346076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 492/972] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Aug 4 02:24:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:01.352399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8d681-5df5-4404-a0d3-a6d7313b9136 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:01.461226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8d681-5df5-4404-a0d3-a6d7313b9136 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:01.495344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fc7a8-7b44-4e72-96bd-fa1ea962c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:01.495962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fc7a8-7b44-4e72-96bd-fa1ea962c0fa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:01.496237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fc7a8-7b44-4e72-96bd-fa1ea962c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:01.496504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fc7a8-7b44-4e72-96bd-fa1ea962c0fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:01.507274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fc7a8-7b44-4e72-96bd-fa1ea962c0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:01.508696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fc7a8-7b44-4e72-96bd-fa1ea962c0fa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-053fc7a8-7b44-4e72-96bd-fa1ea962c0fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:01.523515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:01.524409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:01.530181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:24:01.530181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:01.530181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:01.530181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:01.530181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 481/973] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:01.532303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841ab2b-d01e-4077-8a0c-8ef397b751b6 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:01.639124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841ab2b-d01e-4077-8a0c-8ef397b751b6 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:01.672500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f666c-1cda-4456-8fed-74f4ea643c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:01.673107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f666c-1cda-4456-8fed-74f4ea643c96 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:01.673410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f666c-1cda-4456-8fed-74f4ea643c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:01.673682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f666c-1cda-4456-8fed-74f4ea643c96 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:01.674364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f666c-1cda-4456-8fed-74f4ea643c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:01.674662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f666c-1cda-4456-8fed-74f4ea643c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:01.676649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f666c-1cda-4456-8fed-74f4ea643c96 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:01.693065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 493/974] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:01.694307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fc7a8-7b44-4e72-96bd-fa1ea962c0fa None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:01.729846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:01.798608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fc7a8-7b44-4e72-96bd-fa1ea962c0fa None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:01.832153 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110c8d6-7cdd-4852-acda-f66d8353d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:01.832708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c8d6-7cdd-4852-acda-f66d8353d0cb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:01.832984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c8d6-7cdd-4852-acda-f66d8353d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:01.833250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c8d6-7cdd-4852-acda-f66d8353d0cb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:01.840509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110c8d6-7cdd-4852-acda-f66d8353d0cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:01.841966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110c8d6-7cdd-4852-acda-f66d8353d0cb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-3110c8d6-7cdd-4852-acda-f66d8353d0cb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:24:01.853386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:01.854313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 02:24:01.855280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:01.856589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 482/975] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:24:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:01.860322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f666c-1cda-4456-8fed-74f4ea643c96 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:01.916342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:01.969801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f666c-1cda-4456-8fed-74f4ea643c96 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.004557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7f0e-4814-40ce-9054-9cc410bd0784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.005171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7f0e-4814-40ce-9054-9cc410bd0784 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.005485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7f0e-4814-40ce-9054-9cc410bd0784 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.005762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7f0e-4814-40ce-9054-9cc410bd0784 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.006550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7f0e-4814-40ce-9054-9cc410bd0784 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:02.006858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7f0e-4814-40ce-9054-9cc410bd0784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.008281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7f0e-4814-40ce-9054-9cc410bd0784 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.030786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 494/976] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Aug 4 02:24:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:02.032107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7f0e-4814-40ce-9054-9cc410bd0784 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.032662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd89df-eb91-44e9-bb48-5e0897f9e982 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.033065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd89df-eb91-44e9-bb48-5e0897f9e982 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.033360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd89df-eb91-44e9-bb48-5e0897f9e982 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.034913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 483/977] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:02.040328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84f088-abc8-4bc9-88c1-af109be0c499 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.040613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84f088-abc8-4bc9-88c1-af109be0c499 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.040886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84f088-abc8-4bc9-88c1-af109be0c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.058426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4a84f088-abc8-4bc9-88c1-af109be0c499 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:02.059614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4a84f088-abc8-4bc9-88c1-af109be0c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:02.131418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 484/978] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:02.138631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7f0e-4814-40ce-9054-9cc410bd0784 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.150582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:02.154149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84f088-abc8-4bc9-88c1-af109be0c499 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.176097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f42a-6ba4-4b13-bc4c-6fb4453a71bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.176701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f42a-6ba4-4b13-bc4c-6fb4453a71bf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.176977 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f42a-6ba4-4b13-bc4c-6fb4453a71bf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.177301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f42a-6ba4-4b13-bc4c-6fb4453a71bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.178981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:02.259008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84f088-abc8-4bc9-88c1-af109be0c499 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.262355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f42a-6ba4-4b13-bc4c-6fb4453a71bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.263813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f42a-6ba4-4b13-bc4c-6fb4453a71bf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.295559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250e42c-c37e-4b94-ad86-b4f3dd1b19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.296198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250e42c-c37e-4b94-ad86-b4f3dd1b19ed None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.296478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250e42c-c37e-4b94-ad86-b4f3dd1b19ed None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.296752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250e42c-c37e-4b94-ad86-b4f3dd1b19ed None admin] PATH_INFO: `/v3/services/compute` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.297393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250e42c-c37e-4b94-ad86-b4f3dd1b19ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.298758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250e42c-c37e-4b94-ad86-b4f3dd1b19ed None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f250e42c-c37e-4b94-ad86-b4f3dd1b19ed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:02.308285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:02.309369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:02.315333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 485/979] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:02.316162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250e42c-c37e-4b94-ad86-b4f3dd1b19ed None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.374256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 495/980] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:24:02.379896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f42a-6ba4-4b13-bc4c-6fb4453a71bf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.391655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:02.417978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:02.431484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250e42c-c37e-4b94-ad86-b4f3dd1b19ed None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.466681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e4a2-f175-43dc-bc54-61929b9d7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.467287 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e4a2-f175-43dc-bc54-61929b9d7267 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.467563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e4a2-f175-43dc-bc54-61929b9d7267 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.467829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e4a2-f175-43dc-bc54-61929b9d7267 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.468489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e4a2-f175-43dc-bc54-61929b9d7267 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:02.468784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e4a2-f175-43dc-bc54-61929b9d7267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.470173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e4a2-f175-43dc-bc54-61929b9d7267 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.475683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 486/981] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:02.481147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e4a2-f175-43dc-bc54-61929b9d7267 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.491896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f42a-6ba4-4b13-bc4c-6fb4453a71bf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.530358 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82372f7d-5110-4e0f-bcbd-71ee2f83027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.531351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82372f7d-5110-4e0f-bcbd-71ee2f83027e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.532053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82372f7d-5110-4e0f-bcbd-71ee2f83027e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.532480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82372f7d-5110-4e0f-bcbd-71ee2f83027e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.543673 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82372f7d-5110-4e0f-bcbd-71ee2f83027e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.546032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82372f7d-5110-4e0f-bcbd-71ee2f83027e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-82372f7d-5110-4e0f-bcbd-71ee2f83027e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:02.561599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:02.562508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:02.563480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:24:02.563480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:02.563480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:02.563480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:02.563480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 496/982] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:02.568268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82372f7d-5110-4e0f-bcbd-71ee2f83027e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.593948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e4a2-f175-43dc-bc54-61929b9d7267 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.628267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5fe4-37b3-43e2-9881-de52c6600d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.628904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5fe4-37b3-43e2-9881-de52c6600d5f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.629706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5fe4-37b3-43e2-9881-de52c6600d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.629978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5fe4-37b3-43e2-9881-de52c6600d5f None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.630642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa5fe4-37b3-43e2-9881-de52c6600d5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:02.630942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa5fe4-37b3-43e2-9881-de52c6600d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.632304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa5fe4-37b3-43e2-9881-de52c6600d5f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.637216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 487/983] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:02.642921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5fe4-37b3-43e2-9881-de52c6600d5f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.645980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:02.662532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:02.694213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82372f7d-5110-4e0f-bcbd-71ee2f83027e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.729180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b467937-e9f2-49f1-9b5f-aad90745d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.729833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b467937-e9f2-49f1-9b5f-aad90745d313 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.730109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b467937-e9f2-49f1-9b5f-aad90745d313 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.730404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b467937-e9f2-49f1-9b5f-aad90745d313 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.731054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b467937-e9f2-49f1-9b5f-aad90745d313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:02.731351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b467937-e9f2-49f1-9b5f-aad90745d313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.732724 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b467937-e9f2-49f1-9b5f-aad90745d313 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.747242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 497/984] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:02.752468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b467937-e9f2-49f1-9b5f-aad90745d313 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.758988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5fe4-37b3-43e2-9881-de52c6600d5f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.795370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06946-4153-4601-8fd2-85acafe9bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.796338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06946-4153-4601-8fd2-85acafe9bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.796618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06946-4153-4601-8fd2-85acafe9bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.796892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06946-4153-4601-8fd2-85acafe9bbe0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.798035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d06946-4153-4601-8fd2-85acafe9bbe0 None admin] RBAC: Adding query filter params (interface=public, service_id=1dd96c32b74c4cfbbc93b25fe14b8325, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:02.798319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d06946-4153-4601-8fd2-85acafe9bbe0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.799705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d06946-4153-4601-8fd2-85acafe9bbe0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.810020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 488/985] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/endpoints?service_id=1dd96c32b74c4cfbbc93b25fe14b8325&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:02.811243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06946-4153-4601-8fd2-85acafe9bbe0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.858894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b467937-e9f2-49f1-9b5f-aad90745d313 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.882625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:02.894953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4eab0-b885-41ca-8cdf-ddc2db27a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.895522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4eab0-b885-41ca-8cdf-ddc2db27a658 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.895800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4eab0-b885-41ca-8cdf-ddc2db27a658 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.896076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4eab0-b885-41ca-8cdf-ddc2db27a658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.900941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:02.905297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4eab0-b885-41ca-8cdf-ddc2db27a658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.906770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4eab0-b885-41ca-8cdf-ddc2db27a658 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-f3d4eab0-b885-41ca-8cdf-ddc2db27a658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:24:02.917942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:02.918838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:02.919728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:24:02.919728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:24:02.919728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:24:02.919728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:24:02.919728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:24:02.919728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:24:02.919728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:24:02.919728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:02.919728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 498/986] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:02.924546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06946-4153-4601-8fd2-85acafe9bbe0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:02.924742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4eab0-b885-41ca-8cdf-ddc2db27a658 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:02.961865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bbad1-6496-4e95-b288-f75b5dedb21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:02.962476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bbad1-6496-4e95-b288-f75b5dedb21a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:02.962756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bbad1-6496-4e95-b288-f75b5dedb21a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:02.963031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bbad1-6496-4e95-b288-f75b5dedb21a None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:02.963671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bbad1-6496-4e95-b288-f75b5dedb21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:02.965025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bbad1-6496-4e95-b288-f75b5dedb21a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:02.971549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 489/987] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:24:03.038847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4eab0-b885-41ca-8cdf-ddc2db27a658 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:03.076351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e93a7-ad1d-4d8a-b87b-d24b81ffd1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:03.077028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e93a7-ad1d-4d8a-b87b-d24b81ffd1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:03.077314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e93a7-ad1d-4d8a-b87b-d24b81ffd1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:03.077612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e93a7-ad1d-4d8a-b87b-d24b81ffd1d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:03.078370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e93a7-ad1d-4d8a-b87b-d24b81ffd1d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:03.078675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e93a7-ad1d-4d8a-b87b-d24b81ffd1d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:03.080115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e93a7-ad1d-4d8a-b87b-d24b81ffd1d4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:03.099217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 499/988] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:03.100888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bbad1-6496-4e95-b288-f75b5dedb21a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:03.211307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bbad1-6496-4e95-b288-f75b5dedb21a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:03.245839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbde8e-eefe-4c17-bf72-e83685906811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:03.246453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbde8e-eefe-4c17-bf72-e83685906811 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:03.246731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbde8e-eefe-4c17-bf72-e83685906811 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:03.247000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbde8e-eefe-4c17-bf72-e83685906811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:03.247783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbde8e-eefe-4c17-bf72-e83685906811 None admin] RBAC: Adding query filter params (role.id=0d7c035be92f4ed4bdc212b1ed9a8fce, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=758a5ce9caf046929eec499e6afc1dd8) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:03.248088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbde8e-eefe-4c17-bf72-e83685906811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:03.249542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbde8e-eefe-4c17-bf72-e83685906811 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:03.256478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486f195-4b6a-4731-a475-97ace458a5f9 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:03.256758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486f195-4b6a-4731-a475-97ace458a5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:03.257067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486f195-4b6a-4731-a475-97ace458a5f9 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:03.257174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 490/989] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:03 2022] GET /identity/v3/role_assignments?user.id=758a5ce9caf046929eec499e6afc1dd8&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=0d7c035be92f4ed4bdc212b1ed9a8fce => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:03.261369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 500/990] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:03.264043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb839cc-63a2-40c0-8ea8-98994123f254 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:03.264331 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb839cc-63a2-40c0-8ea8-98994123f254 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:03.264608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb839cc-63a2-40c0-8ea8-98994123f254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:03.288109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2eb839cc-63a2-40c0-8ea8-98994123f254 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:03.289348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2eb839cc-63a2-40c0-8ea8-98994123f254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:03.291912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:03.366723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 491/991] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:03.388380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486f195-4b6a-4731-a475-97ace458a5f9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:03.439452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:03.498789 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486f195-4b6a-4731-a475-97ace458a5f9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:03.532280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1678014-b275-41ba-8830-5718fd9b517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:03.532965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678014-b275-41ba-8830-5718fd9b517f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:03.533247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678014-b275-41ba-8830-5718fd9b517f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:03.533565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678014-b275-41ba-8830-5718fd9b517f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:03.534188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1678014-b275-41ba-8830-5718fd9b517f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:03.536107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1678014-b275-41ba-8830-5718fd9b517f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d1678014-b275-41ba-8830-5718fd9b517f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:03.544928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:03.545954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:03.546805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 501/992] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:24:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:03.553582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb839cc-63a2-40c0-8ea8-98994123f254 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:03.655692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb839cc-63a2-40c0-8ea8-98994123f254 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:03.690256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ab38f-7e8e-41c6-adfc-9d9b411891f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:03.690886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ab38f-7e8e-41c6-adfc-9d9b411891f7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:03.691150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ab38f-7e8e-41c6-adfc-9d9b411891f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:03.691448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ab38f-7e8e-41c6-adfc-9d9b411891f7 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:03.692119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ab38f-7e8e-41c6-adfc-9d9b411891f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:03.692416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ab38f-7e8e-41c6-adfc-9d9b411891f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:03.693803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ab38f-7e8e-41c6-adfc-9d9b411891f7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:03.703200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 492/993] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:24:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:03.704475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1678014-b275-41ba-8830-5718fd9b517f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:03.806487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1678014-b275-41ba-8830-5718fd9b517f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:03.813259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:03.841665 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d099a-4b30-4a6a-b086-e7b8bed2fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:03.842361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d099a-4b30-4a6a-b086-e7b8bed2fa08 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:03.842713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d099a-4b30-4a6a-b086-e7b8bed2fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:03.843058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d099a-4b30-4a6a-b086-e7b8bed2fa08 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:03.843802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d099a-4b30-4a6a-b086-e7b8bed2fa08 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:03.844177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d099a-4b30-4a6a-b086-e7b8bed2fa08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:03.845624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d099a-4b30-4a6a-b086-e7b8bed2fa08 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:03.855216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 502/994] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:24:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:03.856345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ab38f-7e8e-41c6-adfc-9d9b411891f7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:03.859332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:03.958564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ab38f-7e8e-41c6-adfc-9d9b411891f7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:03.993223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c2f6-7105-40a4-bfde-255ec7e9f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:03.993942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c2f6-7105-40a4-bfde-255ec7e9f75c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:03.994291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c2f6-7105-40a4-bfde-255ec7e9f75c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:03.994632 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c2f6-7105-40a4-bfde-255ec7e9f75c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:03.995453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c2f6-7105-40a4-bfde-255ec7e9f75c None admin] RBAC: Adding query filter params (interface=admin, service_id=ccf1acba39c143c2b65c8b622f13a8be, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:03.995832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c2f6-7105-40a4-bfde-255ec7e9f75c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:03.997256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c2f6-7105-40a4-bfde-255ec7e9f75c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:04.006936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 493/995] 10.222.0.69 () {56 vars in 1249 bytes} [Thu Aug 4 02:24:03 2022] GET /identity/v3/endpoints?service_id=ccf1acba39c143c2b65c8b622f13a8be&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:04.008039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d099a-4b30-4a6a-b086-e7b8bed2fa08 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:04.111751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d099a-4b30-4a6a-b086-e7b8bed2fa08 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:04.145434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5221f-8acc-4ae3-8387-638c5b807d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:04.146047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5221f-8acc-4ae3-8387-638c5b807d78 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:04.146326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5221f-8acc-4ae3-8387-638c5b807d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:04.146597 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5221f-8acc-4ae3-8387-638c5b807d78 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:04.147242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5221f-8acc-4ae3-8387-638c5b807d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:04.148601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5221f-8acc-4ae3-8387-638c5b807d78 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:04.155282 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 503/996] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Aug 4 02:24:04 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:24:04.994079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bd2d-2588-46f4-8ff6-527abf7f4e4c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:04.994598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bd2d-2588-46f4-8ff6-527abf7f4e4c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:04.994598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bd2d-2588-46f4-8ff6-527abf7f4e4c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:04.996101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 494/997] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:05.000968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed066e87-8b4e-45e5-90e4-6add7b38d098 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.001366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed066e87-8b4e-45e5-90e4-6add7b38d098 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.001545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed066e87-8b4e-45e5-90e4-6add7b38d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.020220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ed066e87-8b4e-45e5-90e4-6add7b38d098 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:05.021423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ed066e87-8b4e-45e5-90e4-6add7b38d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:05.049139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:05.090706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 504/998] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:05.112705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50bd2d-2588-46f4-8ff6-527abf7f4e4c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:05.180235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:05.217854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50bd2d-2588-46f4-8ff6-527abf7f4e4c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:05.255271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e8489-278e-423d-8032-9744bc42bf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:05.255855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e8489-278e-423d-8032-9744bc42bf4e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.256117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e8489-278e-423d-8032-9744bc42bf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.256379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e8489-278e-423d-8032-9744bc42bf4e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.256982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e8489-278e-423d-8032-9744bc42bf4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:05.258378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e8489-278e-423d-8032-9744bc42bf4e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c80e8489-278e-423d-8032-9744bc42bf4e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:05.267711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:05.268720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:05.270113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 495/999] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:24:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:05.276915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed066e87-8b4e-45e5-90e4-6add7b38d098 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:05.294609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fb068-c2d9-4fbf-8f16-30a4bb1fc409 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.294895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fb068-c2d9-4fbf-8f16-30a4bb1fc409 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.295171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fb068-c2d9-4fbf-8f16-30a4bb1fc409 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.296535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 496/1000] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:24:05.301429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbfc2b-5ea1-4a1b-a0b1-774b7748269f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.301710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbfc2b-5ea1-4a1b-a0b1-774b7748269f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.301983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbfc2b-5ea1-4a1b-a0b1-774b7748269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.322836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-74fbfc2b-5ea1-4a1b-a0b1-774b7748269f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:05.324086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-74fbfc2b-5ea1-4a1b-a0b1-774b7748269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:05.380610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed066e87-8b4e-45e5-90e4-6add7b38d098 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:05.405835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 497/1001] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:05.418815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4b76-e27d-4d99-b028-a50f82ab3ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:05.419421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4b76-e27d-4d99-b028-a50f82ab3ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.419699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4b76-e27d-4d99-b028-a50f82ab3ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.419971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4b76-e27d-4d99-b028-a50f82ab3ec6 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.420639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4b76-e27d-4d99-b028-a50f82ab3ec6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:05.420936 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4b76-e27d-4d99-b028-a50f82ab3ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:05.422316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4b76-e27d-4d99-b028-a50f82ab3ec6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:05.431453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbfc2b-5ea1-4a1b-a0b1-774b7748269f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:05.431599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 505/1002] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:24:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:05.432386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4b76-e27d-4d99-b028-a50f82ab3ec6 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:05.461187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:05.489722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:05.532481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbfc2b-5ea1-4a1b-a0b1-774b7748269f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:05.539115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4b76-e27d-4d99-b028-a50f82ab3ec6 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:05.571892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208ae1d-7e59-4f93-aeee-c47778b54956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:05.572540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ae1d-7e59-4f93-aeee-c47778b54956 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.572821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ae1d-7e59-4f93-aeee-c47778b54956 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.573095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ae1d-7e59-4f93-aeee-c47778b54956 None admin] PATH_INFO: `/v3/services/image` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.574014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208ae1d-7e59-4f93-aeee-c47778b54956 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:05.575120 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208ae1d-7e59-4f93-aeee-c47778b54956 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:05.582605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfaf31-19d4-4a17-b7a5-ead1b9eba004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:05.583397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfaf31-19d4-4a17-b7a5-ead1b9eba004 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.583822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfaf31-19d4-4a17-b7a5-ead1b9eba004 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.584239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfaf31-19d4-4a17-b7a5-ead1b9eba004 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-1208ae1d-7e59-4f93-aeee-c47778b54956 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:05.585080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:05.586252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:24:05.587092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:05.587915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfaf31-19d4-4a17-b7a5-ead1b9eba004 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:05.587988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 498/1003] 10.222.0.69 () {56 vars in 1105 bytes} [Thu Aug 4 02:24:05 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:05.588425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfaf31-19d4-4a17-b7a5-ead1b9eba004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:05.589807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfaf31-19d4-4a17-b7a5-ead1b9eba004 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:05.592459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208ae1d-7e59-4f93-aeee-c47778b54956 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:05.595304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 506/1004] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Aug 4 02:24:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:05.601281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfaf31-19d4-4a17-b7a5-ead1b9eba004 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:05.697245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208ae1d-7e59-4f93-aeee-c47778b54956 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:05.699636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:05.710250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfaf31-19d4-4a17-b7a5-ead1b9eba004 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:05.723130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:05.735193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f8b7c-b424-4b38-97ad-b9939e87c5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:05.735814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f8b7c-b424-4b38-97ad-b9939e87c5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.736091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f8b7c-b424-4b38-97ad-b9939e87c5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.736365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f8b7c-b424-4b38-97ad-b9939e87c5e2 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.737033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f8b7c-b424-4b38-97ad-b9939e87c5e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:05.737365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f8b7c-b424-4b38-97ad-b9939e87c5e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:05.738767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f8b7c-b424-4b38-97ad-b9939e87c5e2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:05.743628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 499/1005] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:05.748985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f8b7c-b424-4b38-97ad-b9939e87c5e2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:05.751540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4b7e3-c4b3-4f47-90c5-10f669088ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:05.752359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b7e3-c4b3-4f47-90c5-10f669088ea8 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.752642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b7e3-c4b3-4f47-90c5-10f669088ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.752916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4b7e3-c4b3-4f47-90c5-10f669088ea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.753671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b7e3-c4b3-4f47-90c5-10f669088ea8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:05.755286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4b7e3-c4b3-4f47-90c5-10f669088ea8 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:05.779169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 507/1006] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:24:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:24:05.872816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f8b7c-b424-4b38-97ad-b9939e87c5e2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:05.916642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c5b33-30f6-4d07-975d-fcc15279a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:05.917698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c5b33-30f6-4d07-975d-fcc15279a424 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:05.918155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c5b33-30f6-4d07-975d-fcc15279a424 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:05.918747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c5b33-30f6-4d07-975d-fcc15279a424 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:05.919611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c5b33-30f6-4d07-975d-fcc15279a424 None admin] RBAC: Adding query filter params (type=image) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:05.920086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c5b33-30f6-4d07-975d-fcc15279a424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:05.921719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c5b33-30f6-4d07-975d-fcc15279a424 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:05.929382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 500/1007] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:06.156804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec69cf-194f-4687-b69b-8ec4b5ac22f0 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:06.157353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec69cf-194f-4687-b69b-8ec4b5ac22f0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:06.157353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec69cf-194f-4687-b69b-8ec4b5ac22f0 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:06.158806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 508/1008] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:06.164621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114d12-54e3-4a26-97f9-74fb1c58b210 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:06.165018 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114d12-54e3-4a26-97f9-74fb1c58b210 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:06.165199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88114d12-54e3-4a26-97f9-74fb1c58b210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:06.183549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-88114d12-54e3-4a26-97f9-74fb1c58b210 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:06.184738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-88114d12-54e3-4a26-97f9-74fb1c58b210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:06.228259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:06.252653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 501/1009] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:06 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:06.275590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec69cf-194f-4687-b69b-8ec4b5ac22f0 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:06.381429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec69cf-194f-4687-b69b-8ec4b5ac22f0 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:06.416592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59a6ee-f95c-49b8-83a2-02bc5a3b06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:06.417148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59a6ee-f95c-49b8-83a2-02bc5a3b06e6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:06.417546 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59a6ee-f95c-49b8-83a2-02bc5a3b06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:06.417824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59a6ee-f95c-49b8-83a2-02bc5a3b06e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:06.418450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59a6ee-f95c-49b8-83a2-02bc5a3b06e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:06.419815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59a6ee-f95c-49b8-83a2-02bc5a3b06e6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-9d59a6ee-f95c-49b8-83a2-02bc5a3b06e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:06.429305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:06.430333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:06.431681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 509/1010] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Aug 4 02:24:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:06.436353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88114d12-54e3-4a26-97f9-74fb1c58b210 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:06.534376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88114d12-54e3-4a26-97f9-74fb1c58b210 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:06.577171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699c8b5-3002-48cf-bd8c-32929cb5e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:06.577820 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c8b5-3002-48cf-bd8c-32929cb5e21b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:06.578101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c8b5-3002-48cf-bd8c-32929cb5e21b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:06.578371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699c8b5-3002-48cf-bd8c-32929cb5e21b None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:06.579041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699c8b5-3002-48cf-bd8c-32929cb5e21b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:06.579338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699c8b5-3002-48cf-bd8c-32929cb5e21b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:06.580696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699c8b5-3002-48cf-bd8c-32929cb5e21b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:06.590828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 502/1011] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:24:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:06.592007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59a6ee-f95c-49b8-83a2-02bc5a3b06e6 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:06.608069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:06.694415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59a6ee-f95c-49b8-83a2-02bc5a3b06e6 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:06.728149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009cce9-517b-4b31-8e17-aa8a6fa1a263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:06.728757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009cce9-517b-4b31-8e17-aa8a6fa1a263 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:06.729032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009cce9-517b-4b31-8e17-aa8a6fa1a263 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:06.729300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009cce9-517b-4b31-8e17-aa8a6fa1a263 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:06.729990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009cce9-517b-4b31-8e17-aa8a6fa1a263 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:06.730288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009cce9-517b-4b31-8e17-aa8a6fa1a263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:06.731624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009cce9-517b-4b31-8e17-aa8a6fa1a263 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:06.736586 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 510/1012] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Aug 4 02:24:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:06.742482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699c8b5-3002-48cf-bd8c-32929cb5e21b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:06.785353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:06.841859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699c8b5-3002-48cf-bd8c-32929cb5e21b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:06.876827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48beda4-4d4e-498a-abd8-df10b1ca10cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:06.877463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48beda4-4d4e-498a-abd8-df10b1ca10cb None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:06.877740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48beda4-4d4e-498a-abd8-df10b1ca10cb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:06.878006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48beda4-4d4e-498a-abd8-df10b1ca10cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:06.878733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48beda4-4d4e-498a-abd8-df10b1ca10cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:06.880080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48beda4-4d4e-498a-abd8-df10b1ca10cb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:06.896219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 503/1013] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:24:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:24:07.915564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e2c82-fd6b-4682-89b5-5eee21fa5d4a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:07.916066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e2c82-fd6b-4682-89b5-5eee21fa5d4a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:07.916066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e2c82-fd6b-4682-89b5-5eee21fa5d4a None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:07.917534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 511/1014] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:07.922372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c3df1-7eef-482a-87c5-c993ca43bd32 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:07.922746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c3df1-7eef-482a-87c5-c993ca43bd32 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:07.922936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c3df1-7eef-482a-87c5-c993ca43bd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:07.941408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-008c3df1-7eef-482a-87c5-c993ca43bd32 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:07.942594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-008c3df1-7eef-482a-87c5-c993ca43bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:07.962151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e39d8-3a18-4de6-807f-c8ba82f59249 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:07.962431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e39d8-3a18-4de6-807f-c8ba82f59249 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:07.962701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e39d8-3a18-4de6-807f-c8ba82f59249 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:07.964311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 512/1015] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:07.968976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226a44-0ef9-436d-8024-eb912829c23a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:07.969260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226a44-0ef9-436d-8024-eb912829c23a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:07.969571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226a44-0ef9-436d-8024-eb912829c23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:07.989733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-96226a44-0ef9-436d-8024-eb912829c23a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:07.990977 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-96226a44-0ef9-436d-8024-eb912829c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:08.033757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 504/1016] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:07 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:08.057860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c3df1-7eef-482a-87c5-c993ca43bd32 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:08.061022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 513/1017] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:07 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:08.083492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226a44-0ef9-436d-8024-eb912829c23a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:08.086858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:08.092511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:08.164162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c3df1-7eef-482a-87c5-c993ca43bd32 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:08.201387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa41d49-d90f-4cb5-a501-837f04528183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:08.202037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa41d49-d90f-4cb5-a501-837f04528183 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:08.202493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa41d49-d90f-4cb5-a501-837f04528183 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:08.202804 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa41d49-d90f-4cb5-a501-837f04528183 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:08.205872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226a44-0ef9-436d-8024-eb912829c23a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:08.213665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa41d49-d90f-4cb5-a501-837f04528183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-3aa41d49-d90f-4cb5-a501-837f04528183 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:08.219041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:08.219967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:08.220818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 505/1018] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Aug 4 02:24:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:08.226247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa41d49-d90f-4cb5-a501-837f04528183 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:08.243272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da5d04-6084-4a87-9f9a-a92f5192985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:08.243886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da5d04-6084-4a87-9f9a-a92f5192985a None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:08.244215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da5d04-6084-4a87-9f9a-a92f5192985a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:08.244491 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da5d04-6084-4a87-9f9a-a92f5192985a None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:08.245277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da5d04-6084-4a87-9f9a-a92f5192985a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:08.246778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da5d04-6084-4a87-9f9a-a92f5192985a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:08.265405 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 514/1019] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:24:08 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:24:08.325906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:08.340298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa41d49-d90f-4cb5-a501-837f04528183 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:08.385457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc4251-da2c-492f-be0e-2bdfeb541699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:08.386099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc4251-da2c-492f-be0e-2bdfeb541699 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:08.386414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc4251-da2c-492f-be0e-2bdfeb541699 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:08.386720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc4251-da2c-492f-be0e-2bdfeb541699 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:08.387468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc4251-da2c-492f-be0e-2bdfeb541699 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:08.387806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc4251-da2c-492f-be0e-2bdfeb541699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:08.389257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc4251-da2c-492f-be0e-2bdfeb541699 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:08.401502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 506/1020] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Aug 4 02:24:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:08.405151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da5d04-6084-4a87-9f9a-a92f5192985a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:08.475607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:08.513246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da5d04-6084-4a87-9f9a-a92f5192985a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:08.547312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56636e96-83a5-460d-b4c9-7ed83ece4620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:08.547975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56636e96-83a5-460d-b4c9-7ed83ece4620 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:08.548258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56636e96-83a5-460d-b4c9-7ed83ece4620 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:08.548534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56636e96-83a5-460d-b4c9-7ed83ece4620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:08.562783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56636e96-83a5-460d-b4c9-7ed83ece4620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:08.564228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56636e96-83a5-460d-b4c9-7ed83ece4620 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-56636e96-83a5-460d-b4c9-7ed83ece4620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:08.580168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:08.581135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:08.582158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:24:08.582158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:08.582158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:08.582158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:08.582158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 515/1021] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:08.587166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc4251-da2c-492f-be0e-2bdfeb541699 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:08.690621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc4251-da2c-492f-be0e-2bdfeb541699 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:08.724719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b68b8-38ec-49f7-b31b-79b206e79ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:08.725375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b68b8-38ec-49f7-b31b-79b206e79ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:08.725748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b68b8-38ec-49f7-b31b-79b206e79ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:08.726005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b68b8-38ec-49f7-b31b-79b206e79ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:08.726728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b68b8-38ec-49f7-b31b-79b206e79ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:08.727063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b68b8-38ec-49f7-b31b-79b206e79ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:08.728460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b68b8-38ec-49f7-b31b-79b206e79ea7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:08.745907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 507/1022] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:08.747516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56636e96-83a5-460d-b4c9-7ed83ece4620 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:08.851951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56636e96-83a5-460d-b4c9-7ed83ece4620 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:08.869382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:08.887533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb573b-92bb-47cb-8d21-1f7bc6b6e381 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:08.887857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb573b-92bb-47cb-8d21-1f7bc6b6e381 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:08.888164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb573b-92bb-47cb-8d21-1f7bc6b6e381 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:08.888705 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615ea19-6dee-4bf7-8bce-30aa22ff4d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:08.889364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615ea19-6dee-4bf7-8bce-30aa22ff4d96 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:08.889653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615ea19-6dee-4bf7-8bce-30aa22ff4d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:08.889850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 508/1023] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:24:08.890011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615ea19-6dee-4bf7-8bce-30aa22ff4d96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:08.895042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aab80-f7ba-456e-bace-665da3666cf5 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:08.895353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aab80-f7ba-456e-bace-665da3666cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:08.895656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aab80-f7ba-456e-bace-665da3666cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:08.898459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615ea19-6dee-4bf7-8bce-30aa22ff4d96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:08.899820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615ea19-6dee-4bf7-8bce-30aa22ff4d96 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:08.910983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d615ea19-6dee-4bf7-8bce-30aa22ff4d96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:24:08.912308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:08.913448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:08.919853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 516/1024] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Aug 4 02:24:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:08.922275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615ea19-6dee-4bf7-8bce-30aa22ff4d96 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:08.922662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e19aab80-f7ba-456e-bace-665da3666cf5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:08.924305 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e19aab80-f7ba-456e-bace-665da3666cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:09.000032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 509/1025] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:09.023234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aab80-f7ba-456e-bace-665da3666cf5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:09.030688 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615ea19-6dee-4bf7-8bce-30aa22ff4d96 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:09.071743 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7513a-2733-4d4d-936f-8859ceaafb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:09.072365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7513a-2733-4d4d-936f-8859ceaafb09 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:09.072641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7513a-2733-4d4d-936f-8859ceaafb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:09.072913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7513a-2733-4d4d-936f-8859ceaafb09 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:09.073731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7513a-2733-4d4d-936f-8859ceaafb09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:09.074261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7513a-2733-4d4d-936f-8859ceaafb09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:09.075450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7513a-2733-4d4d-936f-8859ceaafb09 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:09.093194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 517/1026] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Aug 4 02:24:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:09.099085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7513a-2733-4d4d-936f-8859ceaafb09 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:09.127539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aab80-f7ba-456e-bace-665da3666cf5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:09.135403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:09.164308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a1d2-f07b-449b-834d-30bf02f4d878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:09.164949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a1d2-f07b-449b-834d-30bf02f4d878 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:09.165231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a1d2-f07b-449b-834d-30bf02f4d878 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:09.165537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a1d2-f07b-449b-834d-30bf02f4d878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:09.166674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2a1d2-f07b-449b-834d-30bf02f4d878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:09.168101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2a1d2-f07b-449b-834d-30bf02f4d878 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:09.173494 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 510/1027] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:09.176160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a1d2-f07b-449b-834d-30bf02f4d878 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:09.180046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:09.207078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7513a-2733-4d4d-936f-8859ceaafb09 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:09.245787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2755c57-a163-4511-a806-0223be6111cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:09.246430 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2755c57-a163-4511-a806-0223be6111cf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:09.246712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2755c57-a163-4511-a806-0223be6111cf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:09.246986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2755c57-a163-4511-a806-0223be6111cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:09.279521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a1d2-f07b-449b-834d-30bf02f4d878 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:09.312791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ecc2d-644a-4d55-9c5b-8fe63db01f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:09.313436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ecc2d-644a-4d55-9c5b-8fe63db01f6b None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:09.313717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ecc2d-644a-4d55-9c5b-8fe63db01f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:09.313991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ecc2d-644a-4d55-9c5b-8fe63db01f6b None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:09.314668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ecc2d-644a-4d55-9c5b-8fe63db01f6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:09.316604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ecc2d-644a-4d55-9c5b-8fe63db01f6b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:09.323081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2755c57-a163-4511-a806-0223be6111cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:09.324780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2755c57-a163-4511-a806-0223be6111cf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:09.353356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 511/1028] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:24:09 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:24:09.374586 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:09.450888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 518/1029] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:09 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 02:24:09.457506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ecc2d-644a-4d55-9c5b-8fe63db01f6b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:09.518738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:09.564505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ecc2d-644a-4d55-9c5b-8fe63db01f6b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:09.600615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f74ac-d1f3-4130-9e50-dcb84c5fedf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:09.601262 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f74ac-d1f3-4130-9e50-dcb84c5fedf3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:09.601572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f74ac-d1f3-4130-9e50-dcb84c5fedf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:09.601849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f74ac-d1f3-4130-9e50-dcb84c5fedf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:09.612258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f74ac-d1f3-4130-9e50-dcb84c5fedf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:09.613763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f74ac-d1f3-4130-9e50-dcb84c5fedf3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c82f74ac-d1f3-4130-9e50-dcb84c5fedf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:09.627685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:09.628621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:09.629575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:24:09.629575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:09.629575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:09.629575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:09.629575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 512/1030] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:09.634408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2755c57-a163-4511-a806-0223be6111cf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:09.733692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2755c57-a163-4511-a806-0223be6111cf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:09.767309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a255c-d518-4d15-9a20-49b16eb09694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:09.767926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a255c-d518-4d15-9a20-49b16eb09694 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:09.768214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a255c-d518-4d15-9a20-49b16eb09694 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:09.768492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a255c-d518-4d15-9a20-49b16eb09694 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:09.769712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a255c-d518-4d15-9a20-49b16eb09694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:09.770026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a255c-d518-4d15-9a20-49b16eb09694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:09.771375 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a255c-d518-4d15-9a20-49b16eb09694 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:09.773801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:09.789980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 519/1031] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:09.791211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f74ac-d1f3-4130-9e50-dcb84c5fedf3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:09.893405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f74ac-d1f3-4130-9e50-dcb84c5fedf3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:09.903277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:09.930020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8d80-b166-434b-a7a0-375638f6d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:09.930664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8d80-b166-434b-a7a0-375638f6d372 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:09.930919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8d80-b166-434b-a7a0-375638f6d372 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:09.931190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8d80-b166-434b-a7a0-375638f6d372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:09.937987 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c8d80-b166-434b-a7a0-375638f6d372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:09.939422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c8d80-b166-434b-a7a0-375638f6d372 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-6f4c8d80-b166-434b-a7a0-375638f6d372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:24:09.950611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:09.951492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:09.952587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:24:09.952587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:24:09.952587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:24:09.952587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:24:09.952587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:24:09.952587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:24:09.952587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:24:09.952587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:09.952587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 513/1032] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:09.957644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a255c-d518-4d15-9a20-49b16eb09694 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:10.061115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a255c-d518-4d15-9a20-49b16eb09694 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:10.095063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79d5c8-1b70-4a7e-b78f-19494ce9794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:10.095724 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79d5c8-1b70-4a7e-b78f-19494ce9794f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:10.096063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79d5c8-1b70-4a7e-b78f-19494ce9794f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:10.096346 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79d5c8-1b70-4a7e-b78f-19494ce9794f None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:10.097090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79d5c8-1b70-4a7e-b78f-19494ce9794f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:10.097951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79d5c8-1b70-4a7e-b78f-19494ce9794f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:10.099378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79d5c8-1b70-4a7e-b78f-19494ce9794f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:10.117992 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 520/1033] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:10.119199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8d80-b166-434b-a7a0-375638f6d372 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:10.227130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8d80-b166-434b-a7a0-375638f6d372 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:10.262133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e5335-ba3c-4962-be96-0c30cfd57a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:10.262750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e5335-ba3c-4962-be96-0c30cfd57a02 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:10.263030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e5335-ba3c-4962-be96-0c30cfd57a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:10.263303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e5335-ba3c-4962-be96-0c30cfd57a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:10.264085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e5335-ba3c-4962-be96-0c30cfd57a02 None admin] RBAC: Adding query filter params (role.id=0d7c035be92f4ed4bdc212b1ed9a8fce, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=b0096da9bf564ceca61af67cac713f30) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:10.264392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e5335-ba3c-4962-be96-0c30cfd57a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:10.265847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e5335-ba3c-4962-be96-0c30cfd57a02 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:10.277368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 514/1034] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:10 2022] GET /identity/v3/role_assignments?user.id=b0096da9bf564ceca61af67cac713f30&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=0d7c035be92f4ed4bdc212b1ed9a8fce => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:10.320933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dce0c1-19bf-40c1-9172-120356f955a6 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:10.321206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dce0c1-19bf-40c1-9172-120356f955a6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:10.321591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dce0c1-19bf-40c1-9172-120356f955a6 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:10.323223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 521/1035] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:10.328808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fef7f8-e59f-4088-8126-14a6f0d11a4d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:10.329125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fef7f8-e59f-4088-8126-14a6f0d11a4d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:10.329401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fef7f8-e59f-4088-8126-14a6f0d11a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:10.348288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-21fef7f8-e59f-4088-8126-14a6f0d11a4d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:10.349562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-21fef7f8-e59f-4088-8126-14a6f0d11a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:10.379755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:10.426758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 515/1036] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:10.448567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dce0c1-19bf-40c1-9172-120356f955a6 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:10.507271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:10.557184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dce0c1-19bf-40c1-9172-120356f955a6 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:10.596058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f5e4b-255a-457f-a5e4-34452807c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:10.596689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5e4b-255a-457f-a5e4-34452807c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:10.596963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5e4b-255a-457f-a5e4-34452807c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:10.597250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f5e4b-255a-457f-a5e4-34452807c4a4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:10.597875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f5e4b-255a-457f-a5e4-34452807c4a4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:10.599221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f5e4b-255a-457f-a5e4-34452807c4a4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-496f5e4b-255a-457f-a5e4-34452807c4a4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:10.608157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:10.609184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:24:10.610064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:10.613417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 522/1037] 10.222.0.69 () {56 vars in 1105 bytes} [Thu Aug 4 02:24:10 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:10.615291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fef7f8-e59f-4088-8126-14a6f0d11a4d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:10.718892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fef7f8-e59f-4088-8126-14a6f0d11a4d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:10.752833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eab32-7611-4c78-89a6-c94dca49e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:10.754154 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eab32-7611-4c78-89a6-c94dca49e435 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:10.754538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eab32-7611-4c78-89a6-c94dca49e435 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:10.754969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eab32-7611-4c78-89a6-c94dca49e435 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:10.755739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eab32-7611-4c78-89a6-c94dca49e435 None admin] RBAC: Adding query filter params (name=image) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:10.756205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eab32-7611-4c78-89a6-c94dca49e435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:10.757784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eab32-7611-4c78-89a6-c94dca49e435 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:10.767112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 516/1038] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:10.768320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f5e4b-255a-457f-a5e4-34452807c4a4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:10.868895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f5e4b-255a-457f-a5e4-34452807c4a4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:10.888807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:10.906225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b35fd-8c39-4cc8-8511-08915aaa9141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:10.906905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b35fd-8c39-4cc8-8511-08915aaa9141 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:10.907244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b35fd-8c39-4cc8-8511-08915aaa9141 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:10.907581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b35fd-8c39-4cc8-8511-08915aaa9141 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:10.908316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b35fd-8c39-4cc8-8511-08915aaa9141 None admin] RBAC: Adding query filter params (type=image) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:10.908681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b35fd-8c39-4cc8-8511-08915aaa9141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:10.910728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b35fd-8c39-4cc8-8511-08915aaa9141 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:10.920317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 523/1039] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:10.921891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eab32-7611-4c78-89a6-c94dca49e435 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:10.950885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:11.025116 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eab32-7611-4c78-89a6-c94dca49e435 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:11.058815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c8262-1036-4f2e-ba6a-bd12a73456a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:11.059481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c8262-1036-4f2e-ba6a-bd12a73456a8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:11.059758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c8262-1036-4f2e-ba6a-bd12a73456a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:11.060033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c8262-1036-4f2e-ba6a-bd12a73456a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:11.060769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c8262-1036-4f2e-ba6a-bd12a73456a8 None admin] RBAC: Adding query filter params (interface=public, service_id=95c29ad0bfa6496a891e2eb4d282d2d0, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:11.061071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c8262-1036-4f2e-ba6a-bd12a73456a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:11.062448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c8262-1036-4f2e-ba6a-bd12a73456a8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:11.072104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 517/1040] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Aug 4 02:24:10 2022] GET /identity/v3/endpoints?service_id=95c29ad0bfa6496a891e2eb4d282d2d0&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:11.073603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b35fd-8c39-4cc8-8511-08915aaa9141 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:11.173938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b35fd-8c39-4cc8-8511-08915aaa9141 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:11.206019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942f311-e503-4109-9959-e9df81e620c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:11.207139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942f311-e503-4109-9959-e9df81e620c6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:11.207416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942f311-e503-4109-9959-e9df81e620c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:11.207684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942f311-e503-4109-9959-e9df81e620c6 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:11.208326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942f311-e503-4109-9959-e9df81e620c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:11.209696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942f311-e503-4109-9959-e9df81e620c6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:11.221410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 524/1041] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Aug 4 02:24:11 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:24:11.448764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2048c46-a577-4f23-8d7a-eb2bb7350653 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:11.449117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2048c46-a577-4f23-8d7a-eb2bb7350653 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:11.449383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2048c46-a577-4f23-8d7a-eb2bb7350653 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:11.450844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 518/1042] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:11.455779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938cca2-4a99-4220-b54d-2c3a1f8ec579 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:11.456074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938cca2-4a99-4220-b54d-2c3a1f8ec579 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:11.456352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938cca2-4a99-4220-b54d-2c3a1f8ec579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:11.475013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e938cca2-4a99-4220-b54d-2c3a1f8ec579 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:11.476203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e938cca2-4a99-4220-b54d-2c3a1f8ec579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:11.520425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:11.544585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 525/1043] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:11.569402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2048c46-a577-4f23-8d7a-eb2bb7350653 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:11.664859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:11.677437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2048c46-a577-4f23-8d7a-eb2bb7350653 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:11.713092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187af4b-0288-49bf-926b-bce25ebb715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:11.713778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187af4b-0288-49bf-926b-bce25ebb715b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:11.714127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187af4b-0288-49bf-926b-bce25ebb715b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:11.714472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187af4b-0288-49bf-926b-bce25ebb715b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:11.715791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187af4b-0288-49bf-926b-bce25ebb715b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:11.717286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187af4b-0288-49bf-926b-bce25ebb715b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:11.723719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 519/1044] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:11.724935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938cca2-4a99-4220-b54d-2c3a1f8ec579 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:11.825531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938cca2-4a99-4220-b54d-2c3a1f8ec579 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:11.858825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72525da8-5445-4faf-9996-42129774a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:11.859584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72525da8-5445-4faf-9996-42129774a62b None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:11.859958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72525da8-5445-4faf-9996-42129774a62b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:11.860325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72525da8-5445-4faf-9996-42129774a62b None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:11.861094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72525da8-5445-4faf-9996-42129774a62b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:11.862635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72525da8-5445-4faf-9996-42129774a62b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:11.886994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 526/1045] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:24:11 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:24:12.253943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354d743-b764-4a0a-87d8-e95816d77328 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:12.254474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354d743-b764-4a0a-87d8-e95816d77328 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:12.254474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354d743-b764-4a0a-87d8-e95816d77328 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:12.256038 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 520/1046] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:12.261080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf987fc-830a-4375-92f8-3b4de3257112 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:12.261504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf987fc-830a-4375-92f8-3b4de3257112 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:12.261667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf987fc-830a-4375-92f8-3b4de3257112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:12.280063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bbf987fc-830a-4375-92f8-3b4de3257112 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:12.281560 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bbf987fc-830a-4375-92f8-3b4de3257112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:12.310394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:12.356027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 527/1047] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:12.377400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354d743-b764-4a0a-87d8-e95816d77328 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:12.479839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354d743-b764-4a0a-87d8-e95816d77328 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:12.514337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b957b56-3d26-4147-8053-f917bd00d7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:12.514886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b957b56-3d26-4147-8053-f917bd00d7cf None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:12.515161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b957b56-3d26-4147-8053-f917bd00d7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:12.515429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b957b56-3d26-4147-8053-f917bd00d7cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:12.525222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b957b56-3d26-4147-8053-f917bd00d7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-6b957b56-3d26-4147-8053-f917bd00d7cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:12.530295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:12.531207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:24:12.532076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:12.539603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 521/1048] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Aug 4 02:24:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:12.539756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf987fc-830a-4375-92f8-3b4de3257112 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:12.643225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf987fc-830a-4375-92f8-3b4de3257112 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:12.677670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6983a-fd6e-46cb-9d22-65dc2664f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:12.678568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6983a-fd6e-46cb-9d22-65dc2664f549 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:12.678998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6983a-fd6e-46cb-9d22-65dc2664f549 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:12.679418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6983a-fd6e-46cb-9d22-65dc2664f549 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:12.680280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6983a-fd6e-46cb-9d22-65dc2664f549 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:12.680729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6983a-fd6e-46cb-9d22-65dc2664f549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:12.682259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6983a-fd6e-46cb-9d22-65dc2664f549 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:12.690831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 528/1049] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Aug 4 02:24:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:12.697466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b957b56-3d26-4147-8053-f917bd00d7cf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:12.717831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:12.801350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b957b56-3d26-4147-8053-f917bd00d7cf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:12.834608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217111-7b19-4628-a953-cdd5c14217b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:12.835238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217111-7b19-4628-a953-cdd5c14217b9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:12.835516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217111-7b19-4628-a953-cdd5c14217b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:12.835845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217111-7b19-4628-a953-cdd5c14217b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:12.845694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb217111-7b19-4628-a953-cdd5c14217b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:12.847628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb217111-7b19-4628-a953-cdd5c14217b9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-cb217111-7b19-4628-a953-cdd5c14217b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:12.861944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:12.863454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:12.864406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:24:12.864406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:12.864406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:12.864406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:12.865703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 522/1050] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:12.869360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6983a-fd6e-46cb-9d22-65dc2664f549 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:12.898103 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:13.014658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6983a-fd6e-46cb-9d22-65dc2664f549 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:13.070997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a420a4-2094-4085-bbfe-ec7fe2384f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:13.071950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a420a4-2094-4085-bbfe-ec7fe2384f55 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.072430 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a420a4-2094-4085-bbfe-ec7fe2384f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.072915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a420a4-2094-4085-bbfe-ec7fe2384f55 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.074150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a420a4-2094-4085-bbfe-ec7fe2384f55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:13.074669 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a420a4-2094-4085-bbfe-ec7fe2384f55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:13.077052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a420a4-2094-4085-bbfe-ec7fe2384f55 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:13.102593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 529/1051] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:13.103913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217111-7b19-4628-a953-cdd5c14217b9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.177673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:13.211032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217111-7b19-4628-a953-cdd5c14217b9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:13.242182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae601f-5b53-4882-8436-3f1a8bdd8efb None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.242493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae601f-5b53-4882-8436-3f1a8bdd8efb None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.242735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae601f-5b53-4882-8436-3f1a8bdd8efb None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.244257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 530/1052] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:13.244374 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0692df3-56c0-4347-a5b7-73c560abec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:13.244748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0692df3-56c0-4347-a5b7-73c560abec15 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.245027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0692df3-56c0-4347-a5b7-73c560abec15 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.245296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0692df3-56c0-4347-a5b7-73c560abec15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.249249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e1829-6d16-420d-bd9a-69150e439ec9 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.249555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e1829-6d16-420d-bd9a-69150e439ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.249828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e1829-6d16-420d-bd9a-69150e439ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.253081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0692df3-56c0-4347-a5b7-73c560abec15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:13.254578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0692df3-56c0-4347-a5b7-73c560abec15 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:13.268448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ae3e1829-6d16-420d-bd9a-69150e439ec9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:13.270205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ae3e1829-6d16-420d-bd9a-69150e439ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a0692df3-56c0-4347-a5b7-73c560abec15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:24:13.271278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:13.272198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:24:13.273164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:13.274247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 523/1053] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Aug 4 02:24:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:13.278452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0692df3-56c0-4347-a5b7-73c560abec15 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.353725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 531/1054] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:13.369503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e1829-6d16-420d-bd9a-69150e439ec9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.377071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0692df3-56c0-4347-a5b7-73c560abec15 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:13.387018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:13.406336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:13.413643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d964-16c7-4d80-8a09-9a119ab3e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:13.414253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d964-16c7-4d80-8a09-9a119ab3e623 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.414536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d964-16c7-4d80-8a09-9a119ab3e623 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.414812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d964-16c7-4d80-8a09-9a119ab3e623 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.415605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d964-16c7-4d80-8a09-9a119ab3e623 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:13.415913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d964-16c7-4d80-8a09-9a119ab3e623 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:13.417354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d964-16c7-4d80-8a09-9a119ab3e623 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:13.434716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 524/1055] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Aug 4 02:24:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:13.440102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d964-16c7-4d80-8a09-9a119ab3e623 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.480844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e1829-6d16-420d-bd9a-69150e439ec9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:13.518442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66fad-8f6a-4a8e-9fb4-676a29736971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:13.519624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66fad-8f6a-4a8e-9fb4-676a29736971 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.519902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66fad-8f6a-4a8e-9fb4-676a29736971 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.520170 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66fad-8f6a-4a8e-9fb4-676a29736971 None admin] PATH_INFO: `/v3/services/image` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.520786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e66fad-8f6a-4a8e-9fb4-676a29736971 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:13.522238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e66fad-8f6a-4a8e-9fb4-676a29736971 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-32e66fad-8f6a-4a8e-9fb4-676a29736971 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:13.531372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:13.532362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:13.533203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 532/1056] 10.222.0.69 () {56 vars in 1105 bytes} [Thu Aug 4 02:24:13 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:13.539201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66fad-8f6a-4a8e-9fb4-676a29736971 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.545126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d964-16c7-4d80-8a09-9a119ab3e623 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:13.585547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c9565-b234-4581-ad34-075f5fd0a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:13.586555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c9565-b234-4581-ad34-075f5fd0a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.586838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c9565-b234-4581-ad34-075f5fd0a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.587397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c9565-b234-4581-ad34-075f5fd0a4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.598190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c9565-b234-4581-ad34-075f5fd0a4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:13.599628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c9565-b234-4581-ad34-075f5fd0a4e0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a35c9565-b234-4581-ad34-075f5fd0a4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:13.615438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:13.616365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:13.617260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:24:13.617260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:13.617260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:13.617260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:13.621371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 525/1057] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:13.622061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c9565-b234-4581-ad34-075f5fd0a4e0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.632663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:13.655344 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66fad-8f6a-4a8e-9fb4-676a29736971 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:13.667689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:13.695186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52afed-677e-40d2-8759-e138889831ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:13.696035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52afed-677e-40d2-8759-e138889831ac None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.696478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52afed-677e-40d2-8759-e138889831ac None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.696914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52afed-677e-40d2-8759-e138889831ac None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.697767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52afed-677e-40d2-8759-e138889831ac None admin] RBAC: Adding query filter params (name=image) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:13.698214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52afed-677e-40d2-8759-e138889831ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:13.699708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52afed-677e-40d2-8759-e138889831ac None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:13.709640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 533/1058] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:13.710776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52afed-677e-40d2-8759-e138889831ac None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.732225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c9565-b234-4581-ad34-075f5fd0a4e0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:13.770056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f233db6-1ea5-48e0-9e97-1a48369f7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:13.770682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f233db6-1ea5-48e0-9e97-1a48369f7087 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.770964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f233db6-1ea5-48e0-9e97-1a48369f7087 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.771238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f233db6-1ea5-48e0-9e97-1a48369f7087 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.771922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f233db6-1ea5-48e0-9e97-1a48369f7087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:13.772222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f233db6-1ea5-48e0-9e97-1a48369f7087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:13.773605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f233db6-1ea5-48e0-9e97-1a48369f7087 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:13.786279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 526/1059] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:13.792779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f233db6-1ea5-48e0-9e97-1a48369f7087 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.831336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52afed-677e-40d2-8759-e138889831ac None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:13.867649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5f1d-eecb-4a64-b043-2d887729533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:13.868182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5f1d-eecb-4a64-b043-2d887729533a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.868461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5f1d-eecb-4a64-b043-2d887729533a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.868733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e5f1d-eecb-4a64-b043-2d887729533a None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.869428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e5f1d-eecb-4a64-b043-2d887729533a None admin] RBAC: Adding query filter params (type=image) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:13.869730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e5f1d-eecb-4a64-b043-2d887729533a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:13.871082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e5f1d-eecb-4a64-b043-2d887729533a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:13.881007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 534/1060] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:13.882297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5f1d-eecb-4a64-b043-2d887729533a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.893636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:13.901552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:13.905125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f233db6-1ea5-48e0-9e97-1a48369f7087 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:13.942606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af098d-4ac2-4ce0-96c1-e9998194e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:13.943247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af098d-4ac2-4ce0-96c1-e9998194e212 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:13.943525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af098d-4ac2-4ce0-96c1-e9998194e212 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:13.943790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af098d-4ac2-4ce0-96c1-e9998194e212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:13.951232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af098d-4ac2-4ce0-96c1-e9998194e212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:13.952665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af098d-4ac2-4ce0-96c1-e9998194e212 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-89af098d-4ac2-4ce0-96c1-e9998194e212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:24:13.966737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:13.967674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:13.968671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:24:13.968671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:24:13.968671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:24:13.968671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:24:13.968671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:24:13.968671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:24:13.968671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:24:13.968671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:13.969695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 527/1061] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:13.974551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af098d-4ac2-4ce0-96c1-e9998194e212 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:13.993451 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e5f1d-eecb-4a64-b043-2d887729533a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:14.030527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f772d9-bfe2-442f-9f9c-1ea741903ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:14.031148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f772d9-bfe2-442f-9f9c-1ea741903ff1 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:14.031431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f772d9-bfe2-442f-9f9c-1ea741903ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:14.031706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f772d9-bfe2-442f-9f9c-1ea741903ff1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:14.032414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f772d9-bfe2-442f-9f9c-1ea741903ff1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:14.033811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f772d9-bfe2-442f-9f9c-1ea741903ff1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:14.053620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 535/1062] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:24:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:24:14.054891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a4eb9-323e-4a5e-a503-75e11cac0672 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:14.055178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a4eb9-323e-4a5e-a503-75e11cac0672 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:14.055450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a4eb9-323e-4a5e-a503-75e11cac0672 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:14.061023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 536/1063] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:14.062602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3f6bb-8b1b-4dea-9946-5135340c40c8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:14.062890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3f6bb-8b1b-4dea-9946-5135340c40c8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:14.063165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3f6bb-8b1b-4dea-9946-5135340c40c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:14.082737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-c9a3f6bb-8b1b-4dea-9946-5135340c40c8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:14.083961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c9a3f6bb-8b1b-4dea-9946-5135340c40c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:14.091425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af098d-4ac2-4ce0-96c1-e9998194e212 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:14.138787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a83ba-65da-48a2-8aa1-adec56ba97fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:14.139360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a83ba-65da-48a2-8aa1-adec56ba97fa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:14.139638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a83ba-65da-48a2-8aa1-adec56ba97fa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:14.140136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a83ba-65da-48a2-8aa1-adec56ba97fa None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:14.140997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a83ba-65da-48a2-8aa1-adec56ba97fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:14.141302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a83ba-65da-48a2-8aa1-adec56ba97fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:14.142822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a83ba-65da-48a2-8aa1-adec56ba97fa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:14.148984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:14.166115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 528/1064] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:14.166314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 537/1065] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:14.167401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a83ba-65da-48a2-8aa1-adec56ba97fa None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:14.184940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3f6bb-8b1b-4dea-9946-5135340c40c8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:14.188420 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:14.281972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a83ba-65da-48a2-8aa1-adec56ba97fa None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:14.302674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3f6bb-8b1b-4dea-9946-5135340c40c8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:14.320159 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3223b63-d540-42b6-bb5f-21e399c88dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:14.321754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3223b63-d540-42b6-bb5f-21e399c88dbf None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:14.322243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3223b63-d540-42b6-bb5f-21e399c88dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:14.322712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3223b63-d540-42b6-bb5f-21e399c88dbf None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/b0096da9bf564ceca61af67cac713f30/roles/0d7c035be92f4ed4bdc212b1ed9a8fce` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:14.325919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3223b63-d540-42b6-bb5f-21e399c88dbf None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=b0096da9bf564ceca61af67cac713f30, role_id=0d7c035be92f4ed4bdc212b1ed9a8fce)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:14.328182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3223b63-d540-42b6-bb5f-21e399c88dbf None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:14.339859 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0737b1-18e6-4b32-93fc-c56e0774e372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:14.340621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0737b1-18e6-4b32-93fc-c56e0774e372 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:14.340912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0737b1-18e6-4b32-93fc-c56e0774e372 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:14.341287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0737b1-18e6-4b32-93fc-c56e0774e372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:14.345848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 529/1066] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:24:14 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/b0096da9bf564ceca61af67cac713f30/roles/0d7c035be92f4ed4bdc212b1ed9a8fce => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:24:14.353357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0737b1-18e6-4b32-93fc-c56e0774e372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-ac0737b1-18e6-4b32-93fc-c56e0774e372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:14.358589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:14.359643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:14.360486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 538/1067] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:24:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:14.367000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3223b63-d540-42b6-bb5f-21e399c88dbf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:14.456031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:14.484150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3223b63-d540-42b6-bb5f-21e399c88dbf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:14.524517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410bbb8-83c1-4709-89cc-e9c1082d6728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:14.525139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bbb8-83c1-4709-89cc-e9c1082d6728 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:14.525473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bbb8-83c1-4709-89cc-e9c1082d6728 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:14.525751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bbb8-83c1-4709-89cc-e9c1082d6728 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:14.526464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410bbb8-83c1-4709-89cc-e9c1082d6728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:14.526768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410bbb8-83c1-4709-89cc-e9c1082d6728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:14.528455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410bbb8-83c1-4709-89cc-e9c1082d6728 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:14.537389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 530/1068] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:24:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:14.543018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0737b1-18e6-4b32-93fc-c56e0774e372 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:14.604803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:14.651262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0737b1-18e6-4b32-93fc-c56e0774e372 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:14.686691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c9d3e-f285-42cf-bdb3-ade9bc98f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:14.687326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c9d3e-f285-42cf-bdb3-ade9bc98f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:14.687607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c9d3e-f285-42cf-bdb3-ade9bc98f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:14.687884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c9d3e-f285-42cf-bdb3-ade9bc98f4d8 None admin] PATH_INFO: `/v3/users/fede0c7b0744425bb61105c796e0cd7a` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:14.701535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c9d3e-f285-42cf-bdb3-ade9bc98f4d8 None admin] RBAC: Authorizing `identity:get_user(user_id=fede0c7b0744425bb61105c796e0cd7a)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:14.702966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c9d3e-f285-42cf-bdb3-ade9bc98f4d8 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:14.709781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 539/1069] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:14 2022] GET /identity/v3/users/fede0c7b0744425bb61105c796e0cd7a => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:14.710843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410bbb8-83c1-4709-89cc-e9c1082d6728 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:14.812725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410bbb8-83c1-4709-89cc-e9c1082d6728 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:14.846432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e9d4a-7468-4a69-b4ff-cb7879878281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:14.847075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9d4a-7468-4a69-b4ff-cb7879878281 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:14.847886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9d4a-7468-4a69-b4ff-cb7879878281 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:14.848162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9d4a-7468-4a69-b4ff-cb7879878281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:14.856796 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:14.916708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e9d4a-7468-4a69-b4ff-cb7879878281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:14.918335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e9d4a-7468-4a69-b4ff-cb7879878281 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:15.021589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 531/1070] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 02:24:15.022704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c9d3e-f285-42cf-bdb3-ade9bc98f4d8 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:15.124392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c9d3e-f285-42cf-bdb3-ade9bc98f4d8 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:15.137257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:15.159461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0058f31-fd9b-4ff8-86c7-191b4909742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:15.160608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0058f31-fd9b-4ff8-86c7-191b4909742b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:15.160887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0058f31-fd9b-4ff8-86c7-191b4909742b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:15.161158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0058f31-fd9b-4ff8-86c7-191b4909742b None admin] PATH_INFO: `/v3/projects/35a06b315e7f4b7ba3a0dd7718810986` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:15.162328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0058f31-fd9b-4ff8-86c7-191b4909742b None admin] RBAC: Authorizing `identity:get_project(project_id=35a06b315e7f4b7ba3a0dd7718810986)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:15.163737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0058f31-fd9b-4ff8-86c7-191b4909742b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:15.170355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 540/1071] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:15 2022] GET /identity/v3/projects/35a06b315e7f4b7ba3a0dd7718810986 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:15.171854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e9d4a-7468-4a69-b4ff-cb7879878281 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:15.212750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:15.277162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e9d4a-7468-4a69-b4ff-cb7879878281 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:15.311735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a340e-52f5-45af-bbc8-c2c12a028fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:15.312341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a340e-52f5-45af-bbc8-c2c12a028fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:15.312602 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a340e-52f5-45af-bbc8-c2c12a028fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:15.312872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a340e-52f5-45af-bbc8-c2c12a028fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:15.313689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a340e-52f5-45af-bbc8-c2c12a028fc4 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=35a06b315e7f4b7ba3a0dd7718810986, user.id=fede0c7b0744425bb61105c796e0cd7a) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:15.313994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a340e-52f5-45af-bbc8-c2c12a028fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:15.315412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a340e-52f5-45af-bbc8-c2c12a028fc4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:15.329436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 532/1072] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:15 2022] GET /identity/v3/role_assignments?user.id=fede0c7b0744425bb61105c796e0cd7a&scope.project.id=35a06b315e7f4b7ba3a0dd7718810986&role.id=999cac3070e64b82b981258349005963 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:16.102983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392f040-b908-48c6-b448-d8cb9f258c11 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.103978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392f040-b908-48c6-b448-d8cb9f258c11 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.104629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392f040-b908-48c6-b448-d8cb9f258c11 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.106651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 541/1073] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:16.111385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f355b-9828-47a3-afec-9eac76ee082b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.111911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f355b-9828-47a3-afec-9eac76ee082b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.112388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f355b-9828-47a3-afec-9eac76ee082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.131328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-249f355b-9828-47a3-afec-9eac76ee082b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:16.132839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-249f355b-9828-47a3-afec-9eac76ee082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:16.204863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 533/1074] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:16.226592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392f040-b908-48c6-b448-d8cb9f258c11 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:16.335616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392f040-b908-48c6-b448-d8cb9f258c11 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:16.346835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541133e2-bb78-425a-9b7b-46c751522249 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.347883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541133e2-bb78-425a-9b7b-46c751522249 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.347961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541133e2-bb78-425a-9b7b-46c751522249 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.349322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 534/1075] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:24:16.354328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcbf6a-dd6d-4f21-8609-a0039a78d0ec None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.354607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcbf6a-dd6d-4f21-8609-a0039a78d0ec None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.354811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcbf6a-dd6d-4f21-8609-a0039a78d0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.373295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-54dcbf6a-dd6d-4f21-8609-a0039a78d0ec None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:16.373715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc1ac-ada3-47ea-86fb-2492526e8a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:16.374329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc1ac-ada3-47ea-86fb-2492526e8a87 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.374493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-54dcbf6a-dd6d-4f21-8609-a0039a78d0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:16.374591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc1ac-ada3-47ea-86fb-2492526e8a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.374868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc1ac-ada3-47ea-86fb-2492526e8a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.403844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:16.431660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:16.449378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 535/1076] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:16.455717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edc1ac-ada3-47ea-86fb-2492526e8a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:16.457363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edc1ac-ada3-47ea-86fb-2492526e8a87 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:16.471792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcbf6a-dd6d-4f21-8609-a0039a78d0ec None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:16.568101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 542/1077] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 02:24:16.574134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc1ac-ada3-47ea-86fb-2492526e8a87 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:16.578076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcbf6a-dd6d-4f21-8609-a0039a78d0ec None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:16.614296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f628542-0eb9-40bc-9250-4edec9afe219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:16.615040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f628542-0eb9-40bc-9250-4edec9afe219 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.615258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f628542-0eb9-40bc-9250-4edec9afe219 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.615530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f628542-0eb9-40bc-9250-4edec9afe219 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.625782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f628542-0eb9-40bc-9250-4edec9afe219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-5f628542-0eb9-40bc-9250-4edec9afe219 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:16.630652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:16.631603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:16.632451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 536/1078] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Aug 4 02:24:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:16.637750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f628542-0eb9-40bc-9250-4edec9afe219 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:16.663653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:16.663815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:16.687362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc1ac-ada3-47ea-86fb-2492526e8a87 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:16.729626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19321a32-58ce-4bcb-aa43-f0823a1174ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:16.730273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19321a32-58ce-4bcb-aa43-f0823a1174ca None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.730554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19321a32-58ce-4bcb-aa43-f0823a1174ca None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.731267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19321a32-58ce-4bcb-aa43-f0823a1174ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.743131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f628542-0eb9-40bc-9250-4edec9afe219 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:16.744891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19321a32-58ce-4bcb-aa43-f0823a1174ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:16.747144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19321a32-58ce-4bcb-aa43-f0823a1174ca None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-19321a32-58ce-4bcb-aa43-f0823a1174ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:16.765809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:16.766732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:16.773735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:24:16.773735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:16.773735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:16.773735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:16.773735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 543/1079] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:16.774038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19321a32-58ce-4bcb-aa43-f0823a1174ca None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:16.778572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821c3ce-1a95-4725-b15e-01ef6071828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:16.779190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c3ce-1a95-4725-b15e-01ef6071828b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.779467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c3ce-1a95-4725-b15e-01ef6071828b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.779738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c3ce-1a95-4725-b15e-01ef6071828b None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.780449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821c3ce-1a95-4725-b15e-01ef6071828b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:16.780751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821c3ce-1a95-4725-b15e-01ef6071828b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:16.782178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821c3ce-1a95-4725-b15e-01ef6071828b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:16.790772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 537/1080] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Aug 4 02:24:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:16.796529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821c3ce-1a95-4725-b15e-01ef6071828b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:16.886954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:16.889650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19321a32-58ce-4bcb-aa43-f0823a1174ca None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:16.904127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821c3ce-1a95-4725-b15e-01ef6071828b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:16.929259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:16.935512 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80bd3-a28b-4015-8016-531c66ee1811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:16.936124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80bd3-a28b-4015-8016-531c66ee1811 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.936402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80bd3-a28b-4015-8016-531c66ee1811 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.936675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80bd3-a28b-4015-8016-531c66ee1811 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.937373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80bd3-a28b-4015-8016-531c66ee1811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:16.937681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80bd3-a28b-4015-8016-531c66ee1811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:16.939035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80bd3-a28b-4015-8016-531c66ee1811 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:16.941805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56937b5b-c92b-427e-a317-49cd11d09c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:16.942653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56937b5b-c92b-427e-a317-49cd11d09c12 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:16.943116 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56937b5b-c92b-427e-a317-49cd11d09c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:16.943586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56937b5b-c92b-427e-a317-49cd11d09c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:16.952458 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 544/1081] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:16.964699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56937b5b-c92b-427e-a317-49cd11d09c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:16.966229 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56937b5b-c92b-427e-a317-49cd11d09c12 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-56937b5b-c92b-427e-a317-49cd11d09c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:16.983137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:16.984102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:16.984981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:24:16.984981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:16.984981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:16.984981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:16.984981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 538/1082] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:16.990885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80bd3-a28b-4015-8016-531c66ee1811 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.100021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80bd3-a28b-4015-8016-531c66ee1811 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:17.135396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e23e0-7971-4bff-9282-c53a2a441051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:17.136041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e23e0-7971-4bff-9282-c53a2a441051 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.136283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e23e0-7971-4bff-9282-c53a2a441051 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.136533 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e23e0-7971-4bff-9282-c53a2a441051 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.137269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e23e0-7971-4bff-9282-c53a2a441051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:17.137544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e23e0-7971-4bff-9282-c53a2a441051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:17.138900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e23e0-7971-4bff-9282-c53a2a441051 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:17.152040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 545/1083] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:17.158160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56937b5b-c92b-427e-a317-49cd11d09c12 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.268527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56937b5b-c92b-427e-a317-49cd11d09c12 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:17.303306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65168e-3d23-4711-82ed-3abd33382b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:17.303945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65168e-3d23-4711-82ed-3abd33382b2f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.304045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8062e6-fd93-4006-98b9-426afdc6308a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.304228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65168e-3d23-4711-82ed-3abd33382b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.304319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8062e6-fd93-4006-98b9-426afdc6308a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.304499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65168e-3d23-4711-82ed-3abd33382b2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.304640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8062e6-fd93-4006-98b9-426afdc6308a None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.306010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 546/1084] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:24:17.307604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:17.311003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd2925-3ac1-4b23-a49c-b8ba0bcab7d2 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.311302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd2925-3ac1-4b23-a49c-b8ba0bcab7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.311575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd2925-3ac1-4b23-a49c-b8ba0bcab7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.312854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65168e-3d23-4711-82ed-3abd33382b2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:17.314706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65168e-3d23-4711-82ed-3abd33382b2f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9a65168e-3d23-4711-82ed-3abd33382b2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:24:17.326435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:17.327538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:17.328625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 539/1085] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Aug 4 02:24:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:17.330053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-1bcd2925-3ac1-4b23-a49c-b8ba0bcab7d2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:17.331216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1bcd2925-3ac1-4b23-a49c-b8ba0bcab7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:17.333466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65168e-3d23-4711-82ed-3abd33382b2f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.378274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:17.398131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 547/1086] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:17.420318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd2925-3ac1-4b23-a49c-b8ba0bcab7d2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.430686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65168e-3d23-4711-82ed-3abd33382b2f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:17.463458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8cfc-ac0d-4cfa-a622-b2aabe4e8c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:17.464067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8cfc-ac0d-4cfa-a622-b2aabe4e8c55 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.464347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8cfc-ac0d-4cfa-a622-b2aabe4e8c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.464620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8cfc-ac0d-4cfa-a622-b2aabe4e8c55 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.465436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8cfc-ac0d-4cfa-a622-b2aabe4e8c55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:17.465741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8cfc-ac0d-4cfa-a622-b2aabe4e8c55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:17.467173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8cfc-ac0d-4cfa-a622-b2aabe4e8c55 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:17.484215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 540/1087] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Aug 4 02:24:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:17.490401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8cfc-ac0d-4cfa-a622-b2aabe4e8c55 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.517972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd2925-3ac1-4b23-a49c-b8ba0bcab7d2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:17.544072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:17.555986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88d732-e8b5-4292-bf7a-9045de2864fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:17.556625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d732-e8b5-4292-bf7a-9045de2864fa None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.556901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d732-e8b5-4292-bf7a-9045de2864fa None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.557169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d732-e8b5-4292-bf7a-9045de2864fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.567960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88d732-e8b5-4292-bf7a-9045de2864fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-af88d732-e8b5-4292-bf7a-9045de2864fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:17.572797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:17.573814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:17.574846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 548/1088] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:17.579727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88d732-e8b5-4292-bf7a-9045de2864fa None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.593858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8cfc-ac0d-4cfa-a622-b2aabe4e8c55 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:17.622621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:17.627329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df2772-cf65-45b0-bd52-4e3b5887d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:17.627935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df2772-cf65-45b0-bd52-4e3b5887d895 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.628731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df2772-cf65-45b0-bd52-4e3b5887d895 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.629002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df2772-cf65-45b0-bd52-4e3b5887d895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.678398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88d732-e8b5-4292-bf7a-9045de2864fa None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:17.698186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df2772-cf65-45b0-bd52-4e3b5887d895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:17.699631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df2772-cf65-45b0-bd52-4e3b5887d895 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:17.712439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c46fe-df8a-407e-8d4a-b54a7c24e89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:17.713044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c46fe-df8a-407e-8d4a-b54a7c24e89a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.713320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c46fe-df8a-407e-8d4a-b54a7c24e89a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.713685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c46fe-df8a-407e-8d4a-b54a7c24e89a None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.714385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c46fe-df8a-407e-8d4a-b54a7c24e89a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:17.714679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c46fe-df8a-407e-8d4a-b54a7c24e89a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:17.716001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c46fe-df8a-407e-8d4a-b54a7c24e89a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:17.724215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 549/1089] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:17.729541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c46fe-df8a-407e-8d4a-b54a7c24e89a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.752525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:17.798406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 541/1090] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 02:24:17.804591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df2772-cf65-45b0-bd52-4e3b5887d895 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.827324 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c46fe-df8a-407e-8d4a-b54a7c24e89a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:17.830356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:17.860198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0064f7-2a5a-41ef-a30e-3f7db74fc86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:17.860821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0064f7-2a5a-41ef-a30e-3f7db74fc86c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.861093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0064f7-2a5a-41ef-a30e-3f7db74fc86c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.861389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0064f7-2a5a-41ef-a30e-3f7db74fc86c None admin] PATH_INFO: `/v3/users/fede0c7b0744425bb61105c796e0cd7a` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.863035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0064f7-2a5a-41ef-a30e-3f7db74fc86c None admin] RBAC: Authorizing `identity:get_user(user_id=fede0c7b0744425bb61105c796e0cd7a)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:17.864456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0064f7-2a5a-41ef-a30e-3f7db74fc86c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:17.866067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 550/1091] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:17 2022] GET /identity/v3/users/fede0c7b0744425bb61105c796e0cd7a => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:17.871710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0064f7-2a5a-41ef-a30e-3f7db74fc86c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.901982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df2772-cf65-45b0-bd52-4e3b5887d895 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:17.935420 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f7e43-6f1e-45e2-8513-b000c2eaaa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:17.936052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f7e43-6f1e-45e2-8513-b000c2eaaa14 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:17.936327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f7e43-6f1e-45e2-8513-b000c2eaaa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:17.936596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f7e43-6f1e-45e2-8513-b000c2eaaa14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:17.947699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f7e43-6f1e-45e2-8513-b000c2eaaa14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:17.949127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f7e43-6f1e-45e2-8513-b000c2eaaa14 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d67f7e43-6f1e-45e2-8513-b000c2eaaa14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:17.963270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:17.964198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:17.965093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:24:17.965093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:17.965093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:24:17.965093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:17.965093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 542/1092] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:17.969870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f7e43-6f1e-45e2-8513-b000c2eaaa14 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:17.972661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0064f7-2a5a-41ef-a30e-3f7db74fc86c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:17.978187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:18.006546 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf4f36-ac78-4ad3-8601-c9549cc792a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:18.007174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf4f36-ac78-4ad3-8601-c9549cc792a7 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:18.007479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf4f36-ac78-4ad3-8601-c9549cc792a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:18.007750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf4f36-ac78-4ad3-8601-c9549cc792a7 None admin] PATH_INFO: `/v3/projects/35a06b315e7f4b7ba3a0dd7718810986` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:18.008890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf4f36-ac78-4ad3-8601-c9549cc792a7 None admin] RBAC: Authorizing `identity:get_project(project_id=35a06b315e7f4b7ba3a0dd7718810986)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:18.010341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf4f36-ac78-4ad3-8601-c9549cc792a7 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:18.012002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 551/1093] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:17 2022] GET /identity/v3/projects/35a06b315e7f4b7ba3a0dd7718810986 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:18.017672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf4f36-ac78-4ad3-8601-c9549cc792a7 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:18.057946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:18.070381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f7e43-6f1e-45e2-8513-b000c2eaaa14 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:18.103230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617832-9e30-4734-bdd3-60e6cd75eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:18.103837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617832-9e30-4734-bdd3-60e6cd75eff5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:18.104117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617832-9e30-4734-bdd3-60e6cd75eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:18.104384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617832-9e30-4734-bdd3-60e6cd75eff5 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:18.105090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b617832-9e30-4734-bdd3-60e6cd75eff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:18.105421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b617832-9e30-4734-bdd3-60e6cd75eff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:18.106779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b617832-9e30-4734-bdd3-60e6cd75eff5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:18.116387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf4f36-ac78-4ad3-8601-c9549cc792a7 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:18.118907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 543/1094] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:18.124377 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617832-9e30-4734-bdd3-60e6cd75eff5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:18.149379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a699e-e6df-45df-9f82-6287ddf44eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:18.150047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a699e-e6df-45df-9f82-6287ddf44eec None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:18.150320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a699e-e6df-45df-9f82-6287ddf44eec None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:18.150596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a699e-e6df-45df-9f82-6287ddf44eec None admin] PATH_INFO: `/v3/projects/35a06b315e7f4b7ba3a0dd7718810986/users/fede0c7b0744425bb61105c796e0cd7a/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:18.152798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a699e-e6df-45df-9f82-6287ddf44eec None admin] RBAC: Authorizing `identity:create_grant(project_id=35a06b315e7f4b7ba3a0dd7718810986, user_id=fede0c7b0744425bb61105c796e0cd7a, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:18.154249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a699e-e6df-45df-9f82-6287ddf44eec None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:18.167456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 552/1095] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:24:18 2022] PUT /identity/v3/projects/35a06b315e7f4b7ba3a0dd7718810986/users/fede0c7b0744425bb61105c796e0cd7a/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:24:18.190633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:18.229428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617832-9e30-4734-bdd3-60e6cd75eff5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:18.266358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546857f-fd9e-4b79-9673-d9ca2005279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:18.267004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546857f-fd9e-4b79-9673-d9ca2005279f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:18.267284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546857f-fd9e-4b79-9673-d9ca2005279f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:18.267554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546857f-fd9e-4b79-9673-d9ca2005279f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:18.275003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546857f-fd9e-4b79-9673-d9ca2005279f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:18.276476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546857f-fd9e-4b79-9673-d9ca2005279f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4546857f-fd9e-4b79-9673-d9ca2005279f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:24:18.289278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:18.290435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:18.296293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:24:18.296293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:24:18.296293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:24:18.296293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:24:18.296293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:24:18.296293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:24:18.296293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:24:18.296293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:18.296293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 544/1096] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:18.296794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a699e-e6df-45df-9f82-6287ddf44eec None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:18.393625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:18.396679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a699e-e6df-45df-9f82-6287ddf44eec None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:18.431505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0c9bd-7efd-4a22-ba18-938b8aec2772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:18.432115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0c9bd-7efd-4a22-ba18-938b8aec2772 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:18.432391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0c9bd-7efd-4a22-ba18-938b8aec2772 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:18.432661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0c9bd-7efd-4a22-ba18-938b8aec2772 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:18.433439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0c9bd-7efd-4a22-ba18-938b8aec2772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:18.433744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0c9bd-7efd-4a22-ba18-938b8aec2772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:18.435183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0c9bd-7efd-4a22-ba18-938b8aec2772 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:18.447007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 553/1097] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:18.454082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546857f-fd9e-4b79-9673-d9ca2005279f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:18.553715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546857f-fd9e-4b79-9673-d9ca2005279f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:18.578817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:18.588477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9d38e-dcd7-471b-9d15-0fd123bb7483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:18.589085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d38e-dcd7-471b-9d15-0fd123bb7483 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:18.589395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d38e-dcd7-471b-9d15-0fd123bb7483 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:18.589673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d38e-dcd7-471b-9d15-0fd123bb7483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:18.590481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9d38e-dcd7-471b-9d15-0fd123bb7483 None admin] RBAC: Adding query filter params (role.id=0d7c035be92f4ed4bdc212b1ed9a8fce, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=b0096da9bf564ceca61af67cac713f30) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:18.590786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9d38e-dcd7-471b-9d15-0fd123bb7483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:18.592204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9d38e-dcd7-471b-9d15-0fd123bb7483 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:18.598580 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 545/1098] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:18 2022] GET /identity/v3/role_assignments?user.id=b0096da9bf564ceca61af67cac713f30&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=0d7c035be92f4ed4bdc212b1ed9a8fce => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:20.158118 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09fc96-02c6-4769-b566-51fec9b78113 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:20.158643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09fc96-02c6-4769-b566-51fec9b78113 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:20.158643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09fc96-02c6-4769-b566-51fec9b78113 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:20.160010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 554/1099] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:20.165159 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0c9a0-a647-4ebd-83cb-d9a14b5ba8e2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:20.165556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0c9a0-a647-4ebd-83cb-d9a14b5ba8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:20.165759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0c9a0-a647-4ebd-83cb-d9a14b5ba8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:20.183997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3fd0c9a0-a647-4ebd-83cb-d9a14b5ba8e2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:20.185182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3fd0c9a0-a647-4ebd-83cb-d9a14b5ba8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:20.250167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 546/1100] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:20.274269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09fc96-02c6-4769-b566-51fec9b78113 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:20.372892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09fc96-02c6-4769-b566-51fec9b78113 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:20.405570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ecdae-c289-46dc-80ff-61090bfafb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:20.406184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ecdae-c289-46dc-80ff-61090bfafb1e None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:20.406461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ecdae-c289-46dc-80ff-61090bfafb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:20.406733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ecdae-c289-46dc-80ff-61090bfafb1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:20.416978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ecdae-c289-46dc-80ff-61090bfafb1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-998ecdae-c289-46dc-80ff-61090bfafb1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:20.421780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:20.422861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:20.423907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 555/1101] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:20.429477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0c9a0-a647-4ebd-83cb-d9a14b5ba8e2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:20.524032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0c9a0-a647-4ebd-83cb-d9a14b5ba8e2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:20.543934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:20.558358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164267f6-6ff4-4b93-a9f9-32a3d88ed1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:20.558967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164267f6-6ff4-4b93-a9f9-32a3d88ed1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:20.559245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164267f6-6ff4-4b93-a9f9-32a3d88ed1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:20.559543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164267f6-6ff4-4b93-a9f9-32a3d88ed1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:20.560243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164267f6-6ff4-4b93-a9f9-32a3d88ed1c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:20.560543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164267f6-6ff4-4b93-a9f9-32a3d88ed1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:20.562014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164267f6-6ff4-4b93-a9f9-32a3d88ed1c7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:20.570103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 547/1102] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:20.575752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ecdae-c289-46dc-80ff-61090bfafb1e None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:20.597981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:20.674300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ecdae-c289-46dc-80ff-61090bfafb1e None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:20.707693 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cd14a-a343-436e-88c6-ec9d40f8ceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:20.708318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cd14a-a343-436e-88c6-ec9d40f8ceba None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:20.708599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cd14a-a343-436e-88c6-ec9d40f8ceba None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:20.708877 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cd14a-a343-436e-88c6-ec9d40f8ceba None admin] PATH_INFO: `/v3/users/fede0c7b0744425bb61105c796e0cd7a` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:20.710051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cd14a-a343-436e-88c6-ec9d40f8ceba None admin] RBAC: Authorizing `identity:get_user(user_id=fede0c7b0744425bb61105c796e0cd7a)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:20.711467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cd14a-a343-436e-88c6-ec9d40f8ceba None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:20.713043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 556/1103] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:20 2022] GET /identity/v3/users/fede0c7b0744425bb61105c796e0cd7a => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:20.718683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164267f6-6ff4-4b93-a9f9-32a3d88ed1c7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:20.817179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164267f6-6ff4-4b93-a9f9-32a3d88ed1c7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:20.848997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03a406-bd44-4b27-bf8d-9929c0fd70eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:20.849620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03a406-bd44-4b27-bf8d-9929c0fd70eb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:20.849903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03a406-bd44-4b27-bf8d-9929c0fd70eb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:20.850178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03a406-bd44-4b27-bf8d-9929c0fd70eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:20.897236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:20.915446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03a406-bd44-4b27-bf8d-9929c0fd70eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:20.916885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03a406-bd44-4b27-bf8d-9929c0fd70eb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:21.012201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 548/1104] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:24:21.017976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cd14a-a343-436e-88c6-ec9d40f8ceba None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:21.103915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:21.115803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cd14a-a343-436e-88c6-ec9d40f8ceba None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:21.148655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cefa44-3711-4773-924f-be2290063420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:21.149265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cefa44-3711-4773-924f-be2290063420 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:21.149564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cefa44-3711-4773-924f-be2290063420 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:21.149830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cefa44-3711-4773-924f-be2290063420 None admin] PATH_INFO: `/v3/projects/35a06b315e7f4b7ba3a0dd7718810986` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:21.150945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cefa44-3711-4773-924f-be2290063420 None admin] RBAC: Authorizing `identity:get_project(project_id=35a06b315e7f4b7ba3a0dd7718810986)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:21.152611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cefa44-3711-4773-924f-be2290063420 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:21.154261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 557/1105] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:21 2022] GET /identity/v3/projects/35a06b315e7f4b7ba3a0dd7718810986 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:21.160221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03a406-bd44-4b27-bf8d-9929c0fd70eb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:21.240522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:21.258970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03a406-bd44-4b27-bf8d-9929c0fd70eb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:21.293238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe60259-251a-49a2-a019-430ce9171d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:21.293810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe60259-251a-49a2-a019-430ce9171d80 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:21.294089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe60259-251a-49a2-a019-430ce9171d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:21.294360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe60259-251a-49a2-a019-430ce9171d80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:21.295127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe60259-251a-49a2-a019-430ce9171d80 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=35a06b315e7f4b7ba3a0dd7718810986, user.id=fede0c7b0744425bb61105c796e0cd7a) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:21.295431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe60259-251a-49a2-a019-430ce9171d80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:21.296848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe60259-251a-49a2-a019-430ce9171d80 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:21.303018 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 549/1106] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:21 2022] GET /identity/v3/role_assignments?user.id=fede0c7b0744425bb61105c796e0cd7a&scope.project.id=35a06b315e7f4b7ba3a0dd7718810986&role.id=999cac3070e64b82b981258349005963 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:23.301317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947829a8-58f0-4f80-8258-20d87617ad6a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:23.301863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947829a8-58f0-4f80-8258-20d87617ad6a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:23.301954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947829a8-58f0-4f80-8258-20d87617ad6a None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:23.303258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 558/1107] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:23.308323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724c9d0-e628-49ff-b1b4-eebb42cb7539 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:23.308689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724c9d0-e628-49ff-b1b4-eebb42cb7539 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:23.308864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724c9d0-e628-49ff-b1b4-eebb42cb7539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:23.326848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5724c9d0-e628-49ff-b1b4-eebb42cb7539 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:23.328009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5724c9d0-e628-49ff-b1b4-eebb42cb7539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:23.391091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 550/1108] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:23.415985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947829a8-58f0-4f80-8258-20d87617ad6a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:23.514013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947829a8-58f0-4f80-8258-20d87617ad6a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:23.546832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efc659-2ae4-49df-a609-1c78e98cee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:23.547446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efc659-2ae4-49df-a609-1c78e98cee99 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:23.547725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efc659-2ae4-49df-a609-1c78e98cee99 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:23.547996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efc659-2ae4-49df-a609-1c78e98cee99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:23.549121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efc659-2ae4-49df-a609-1c78e98cee99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:23.550591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efc659-2ae4-49df-a609-1c78e98cee99 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:23.552257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 559/1109] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:23.557964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724c9d0-e628-49ff-b1b4-eebb42cb7539 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:23.631959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:23.655442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724c9d0-e628-49ff-b1b4-eebb42cb7539 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:23.687498 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45f946-878a-421a-83a2-aeecb614dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:23.688097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f946-878a-421a-83a2-aeecb614dc72 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:23.688375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f946-878a-421a-83a2-aeecb614dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:23.688647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45f946-878a-421a-83a2-aeecb614dc72 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:23.689347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f946-878a-421a-83a2-aeecb614dc72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:23.691283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45f946-878a-421a-83a2-aeecb614dc72 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:23.711931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 551/1110] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:24:23 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:24:25.714439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e5f73-0a58-4e58-9115-4d67f972de66 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:25.714933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e5f73-0a58-4e58-9115-4d67f972de66 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:25.715045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e5f73-0a58-4e58-9115-4d67f972de66 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:25.716325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 560/1111] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:25.721353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57359202-f19a-4957-ab27-afb74b430de2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:25.721791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57359202-f19a-4957-ab27-afb74b430de2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:25.721933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57359202-f19a-4957-ab27-afb74b430de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:25.739563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-57359202-f19a-4957-ab27-afb74b430de2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:25.740746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-57359202-f19a-4957-ab27-afb74b430de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:25.806861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 552/1112] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:25.829845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e5f73-0a58-4e58-9115-4d67f972de66 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:25.854536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:25.930435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e5f73-0a58-4e58-9115-4d67f972de66 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:25.963011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652849b-f81d-43a4-828a-5863b7de5327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:25.963640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652849b-f81d-43a4-828a-5863b7de5327 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:25.963920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652849b-f81d-43a4-828a-5863b7de5327 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:25.964197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652849b-f81d-43a4-828a-5863b7de5327 None admin] PATH_INFO: `/v3/roles/9bd0594bb1684b5eaa192f6669a7fc36` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:25.965658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652849b-f81d-43a4-828a-5863b7de5327 None admin] RBAC: Authorizing `identity:get_role(role_id=9bd0594bb1684b5eaa192f6669a7fc36)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:25.967004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652849b-f81d-43a4-828a-5863b7de5327 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:25.968342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 561/1113] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:25 2022] GET /identity/v3/roles/9bd0594bb1684b5eaa192f6669a7fc36 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:25.974821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57359202-f19a-4957-ab27-afb74b430de2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:26.034104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:26.072984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57359202-f19a-4957-ab27-afb74b430de2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:26.105819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97035358-09f2-426a-a31a-a34d46f42c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:26.106387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97035358-09f2-426a-a31a-a34d46f42c5d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:26.106669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97035358-09f2-426a-a31a-a34d46f42c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:26.106945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97035358-09f2-426a-a31a-a34d46f42c5d None admin] PATH_INFO: `/v3/users/6116751952cc4e549f6b291381584e0d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:26.120230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97035358-09f2-426a-a31a-a34d46f42c5d None admin] RBAC: Authorizing `identity:get_user(user_id=6116751952cc4e549f6b291381584e0d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:26.121685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97035358-09f2-426a-a31a-a34d46f42c5d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:26.123288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 553/1114] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:25 2022] GET /identity/v3/users/6116751952cc4e549f6b291381584e0d => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:26.129704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652849b-f81d-43a4-828a-5863b7de5327 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:26.217529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:26.227056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652849b-f81d-43a4-828a-5863b7de5327 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:26.259020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87444e77-b2d5-406d-8fbb-c50bb7d5e4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:26.259615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87444e77-b2d5-406d-8fbb-c50bb7d5e4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:26.259891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87444e77-b2d5-406d-8fbb-c50bb7d5e4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:26.260160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87444e77-b2d5-406d-8fbb-c50bb7d5e4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:26.324750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87444e77-b2d5-406d-8fbb-c50bb7d5e4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:26.326207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87444e77-b2d5-406d-8fbb-c50bb7d5e4c1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:26.411225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:26.420291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 562/1115] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:24:26.426300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97035358-09f2-426a-a31a-a34d46f42c5d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:26.522221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97035358-09f2-426a-a31a-a34d46f42c5d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:26.541711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:26.555743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67042a89-6249-4c16-99ad-7af514c75a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:26.556394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042a89-6249-4c16-99ad-7af514c75a6a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:26.556669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042a89-6249-4c16-99ad-7af514c75a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:26.556938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042a89-6249-4c16-99ad-7af514c75a6a None admin] PATH_INFO: `/v3/projects/35a06b315e7f4b7ba3a0dd7718810986` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:26.558090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67042a89-6249-4c16-99ad-7af514c75a6a None admin] RBAC: Authorizing `identity:get_project(project_id=35a06b315e7f4b7ba3a0dd7718810986)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:26.559508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67042a89-6249-4c16-99ad-7af514c75a6a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:26.561183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 554/1116] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:26 2022] GET /identity/v3/projects/35a06b315e7f4b7ba3a0dd7718810986 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:26.567666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87444e77-b2d5-406d-8fbb-c50bb7d5e4c1 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:26.665673 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87444e77-b2d5-406d-8fbb-c50bb7d5e4c1 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:26.698854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e1c7e-b246-4e5c-951d-7c0dac2f3fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:26.699451 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e1c7e-b246-4e5c-951d-7c0dac2f3fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:26.699729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e1c7e-b246-4e5c-951d-7c0dac2f3fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:26.700002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e1c7e-b246-4e5c-951d-7c0dac2f3fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:26.700777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e1c7e-b246-4e5c-951d-7c0dac2f3fa2 None admin] RBAC: Adding query filter params (role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=35a06b315e7f4b7ba3a0dd7718810986, user.id=6116751952cc4e549f6b291381584e0d) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:26.701084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e1c7e-b246-4e5c-951d-7c0dac2f3fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:26.702524 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e1c7e-b246-4e5c-951d-7c0dac2f3fa2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:26.708245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 563/1117] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:26 2022] GET /identity/v3/role_assignments?user.id=6116751952cc4e549f6b291381584e0d&scope.project.id=35a06b315e7f4b7ba3a0dd7718810986&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:28.627043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c8e36-b8b9-4ae8-8d88-f067992e80d3 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:28.627537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c8e36-b8b9-4ae8-8d88-f067992e80d3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:28.628132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c8e36-b8b9-4ae8-8d88-f067992e80d3 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:28.629454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 555/1118] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:28.634587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced4217-a2e1-41c6-9418-d413cd72498e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:28.634982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced4217-a2e1-41c6-9418-d413cd72498e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:28.635130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced4217-a2e1-41c6-9418-d413cd72498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:28.653520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8ced4217-a2e1-41c6-9418-d413cd72498e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:28.654694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8ced4217-a2e1-41c6-9418-d413cd72498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:28.703041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:28.719224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 564/1119] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:28.741643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c8e36-b8b9-4ae8-8d88-f067992e80d3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:28.839915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c8e36-b8b9-4ae8-8d88-f067992e80d3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:28.871498 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592291-5a8e-468b-8eed-1118fee8ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:28.872111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592291-5a8e-468b-8eed-1118fee8ebbc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:28.872383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592291-5a8e-468b-8eed-1118fee8ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:28.872650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592291-5a8e-468b-8eed-1118fee8ebbc None admin] PATH_INFO: `/v3/roles/9bd0594bb1684b5eaa192f6669a7fc36` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:28.874073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f592291-5a8e-468b-8eed-1118fee8ebbc None admin] RBAC: Authorizing `identity:get_role(role_id=9bd0594bb1684b5eaa192f6669a7fc36)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:28.875418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f592291-5a8e-468b-8eed-1118fee8ebbc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:28.876721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 556/1120] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:28 2022] GET /identity/v3/roles/9bd0594bb1684b5eaa192f6669a7fc36 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:28.882723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced4217-a2e1-41c6-9418-d413cd72498e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:28.977960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced4217-a2e1-41c6-9418-d413cd72498e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:29.010623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674c65-7a1b-4716-b939-6f6f4a7812c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:29.011240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674c65-7a1b-4716-b939-6f6f4a7812c0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:29.011517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674c65-7a1b-4716-b939-6f6f4a7812c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:29.011789 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674c65-7a1b-4716-b939-6f6f4a7812c0 None admin] PATH_INFO: `/v3/users/6116751952cc4e549f6b291381584e0d` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:29.012927 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674c65-7a1b-4716-b939-6f6f4a7812c0 None admin] RBAC: Authorizing `identity:get_user(user_id=6116751952cc4e549f6b291381584e0d)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:29.014364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674c65-7a1b-4716-b939-6f6f4a7812c0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:29.015931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 565/1121] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:28 2022] GET /identity/v3/users/6116751952cc4e549f6b291381584e0d => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:29.021342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592291-5a8e-468b-8eed-1118fee8ebbc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:29.075314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:29.116591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592291-5a8e-468b-8eed-1118fee8ebbc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:29.148633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55326347-eeec-477b-8d9d-e509617f745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:29.149246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55326347-eeec-477b-8d9d-e509617f745e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:29.149548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55326347-eeec-477b-8d9d-e509617f745e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:29.149818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55326347-eeec-477b-8d9d-e509617f745e None admin] PATH_INFO: `/v3/projects/35a06b315e7f4b7ba3a0dd7718810986` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:29.150928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55326347-eeec-477b-8d9d-e509617f745e None admin] RBAC: Authorizing `identity:get_project(project_id=35a06b315e7f4b7ba3a0dd7718810986)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:29.152604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55326347-eeec-477b-8d9d-e509617f745e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:29.154244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 557/1122] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:29 2022] GET /identity/v3/projects/35a06b315e7f4b7ba3a0dd7718810986 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:29.159948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674c65-7a1b-4716-b939-6f6f4a7812c0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:29.213417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:29.257031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674c65-7a1b-4716-b939-6f6f4a7812c0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:29.290144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d92f4-7f36-4389-9559-750ebecbaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:29.290834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d92f4-7f36-4389-9559-750ebecbaf7d None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:29.291111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d92f4-7f36-4389-9559-750ebecbaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:29.291385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d92f4-7f36-4389-9559-750ebecbaf7d None admin] PATH_INFO: `/v3/projects/35a06b315e7f4b7ba3a0dd7718810986/users/6116751952cc4e549f6b291381584e0d/roles/9bd0594bb1684b5eaa192f6669a7fc36` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:29.293527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d92f4-7f36-4389-9559-750ebecbaf7d None admin] RBAC: Authorizing `identity:create_grant(project_id=35a06b315e7f4b7ba3a0dd7718810986, user_id=6116751952cc4e549f6b291381584e0d, role_id=9bd0594bb1684b5eaa192f6669a7fc36)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:29.294931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d92f4-7f36-4389-9559-750ebecbaf7d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:29.307194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 566/1123] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:24:29 2022] PUT /identity/v3/projects/35a06b315e7f4b7ba3a0dd7718810986/users/6116751952cc4e549f6b291381584e0d/roles/9bd0594bb1684b5eaa192f6669a7fc36 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:24:31.235483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1938c-52cc-4773-bccb-00eef167738b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:31.236040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1938c-52cc-4773-bccb-00eef167738b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:31.236040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1938c-52cc-4773-bccb-00eef167738b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:31.237921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 558/1124] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:31.242891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206c54b-682b-43c7-bc79-6bb523bdebb6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:31.243268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206c54b-682b-43c7-bc79-6bb523bdebb6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:31.243430 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206c54b-682b-43c7-bc79-6bb523bdebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:31.261700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-a206c54b-682b-43c7-bc79-6bb523bdebb6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:31.262901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a206c54b-682b-43c7-bc79-6bb523bdebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:31.327423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 567/1125] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:31.349847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1938c-52cc-4773-bccb-00eef167738b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:31.447832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1938c-52cc-4773-bccb-00eef167738b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:31.469951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:31.480673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d784-1a2f-43c6-9ee1-18ffabbff507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:31.481293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d784-1a2f-43c6-9ee1-18ffabbff507 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:31.481606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d784-1a2f-43c6-9ee1-18ffabbff507 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:31.481879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d784-1a2f-43c6-9ee1-18ffabbff507 None admin] PATH_INFO: `/v3/roles/9bd0594bb1684b5eaa192f6669a7fc36` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:31.483282 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2d784-1a2f-43c6-9ee1-18ffabbff507 None admin] RBAC: Authorizing `identity:get_role(role_id=9bd0594bb1684b5eaa192f6669a7fc36)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:31.484637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2d784-1a2f-43c6-9ee1-18ffabbff507 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:31.486021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 559/1126] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:31 2022] GET /identity/v3/roles/9bd0594bb1684b5eaa192f6669a7fc36 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:31.492030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206c54b-682b-43c7-bc79-6bb523bdebb6 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:31.535476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:31.588931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206c54b-682b-43c7-bc79-6bb523bdebb6 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:31.622262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058494c-d94c-4833-9ec9-fcfd5fc39e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:31.622889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058494c-d94c-4833-9ec9-fcfd5fc39e47 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:31.623167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058494c-d94c-4833-9ec9-fcfd5fc39e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:31.623446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058494c-d94c-4833-9ec9-fcfd5fc39e47 None admin] PATH_INFO: `/v3/users/6116751952cc4e549f6b291381584e0d` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:31.624592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058494c-d94c-4833-9ec9-fcfd5fc39e47 None admin] RBAC: Authorizing `identity:get_user(user_id=6116751952cc4e549f6b291381584e0d)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:31.626040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058494c-d94c-4833-9ec9-fcfd5fc39e47 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:31.627665 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 568/1127] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:31 2022] GET /identity/v3/users/6116751952cc4e549f6b291381584e0d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:31.633291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d784-1a2f-43c6-9ee1-18ffabbff507 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:31.729583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d784-1a2f-43c6-9ee1-18ffabbff507 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:31.762329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ee0b6-2e4b-4e1a-bd16-bf3966c18c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:31.762868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ee0b6-2e4b-4e1a-bd16-bf3966c18c67 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:31.763146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ee0b6-2e4b-4e1a-bd16-bf3966c18c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:31.763419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ee0b6-2e4b-4e1a-bd16-bf3966c18c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:31.818747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:31.828516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ee0b6-2e4b-4e1a-bd16-bf3966c18c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:31.829982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ee0b6-2e4b-4e1a-bd16-bf3966c18c67 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:31.923915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 560/1128] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:24:31.930149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058494c-d94c-4833-9ec9-fcfd5fc39e47 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:32.025146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058494c-d94c-4833-9ec9-fcfd5fc39e47 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:32.038484 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:32.059053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290499d-2108-4412-bff6-17c01617618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:32.059667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290499d-2108-4412-bff6-17c01617618b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:32.059942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290499d-2108-4412-bff6-17c01617618b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:32.060210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290499d-2108-4412-bff6-17c01617618b None admin] PATH_INFO: `/v3/projects/35a06b315e7f4b7ba3a0dd7718810986` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:32.061341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290499d-2108-4412-bff6-17c01617618b None admin] RBAC: Authorizing `identity:get_project(project_id=35a06b315e7f4b7ba3a0dd7718810986)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:32.062745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290499d-2108-4412-bff6-17c01617618b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:32.064371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 569/1129] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:31 2022] GET /identity/v3/projects/35a06b315e7f4b7ba3a0dd7718810986 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:32.070927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ee0b6-2e4b-4e1a-bd16-bf3966c18c67 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:32.161235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:32.170278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ee0b6-2e4b-4e1a-bd16-bf3966c18c67 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:32.203999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7dbe8-9331-4c65-8180-7952eaf85cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:32.204593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7dbe8-9331-4c65-8180-7952eaf85cff None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:32.204874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7dbe8-9331-4c65-8180-7952eaf85cff None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:32.205143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7dbe8-9331-4c65-8180-7952eaf85cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:32.205979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7dbe8-9331-4c65-8180-7952eaf85cff None admin] RBAC: Adding query filter params (role.id=9bd0594bb1684b5eaa192f6669a7fc36, scope.project.id=35a06b315e7f4b7ba3a0dd7718810986, user.id=6116751952cc4e549f6b291381584e0d) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:32.206283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7dbe8-9331-4c65-8180-7952eaf85cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:32.207688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7dbe8-9331-4c65-8180-7952eaf85cff None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:32.213463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 561/1130] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:32 2022] GET /identity/v3/role_assignments?user.id=6116751952cc4e549f6b291381584e0d&scope.project.id=35a06b315e7f4b7ba3a0dd7718810986&role.id=9bd0594bb1684b5eaa192f6669a7fc36 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:34.185224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10c9d1-917c-4948-96bb-cf66b2acab1a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:34.185806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10c9d1-917c-4948-96bb-cf66b2acab1a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:34.185806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10c9d1-917c-4948-96bb-cf66b2acab1a None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:34.187137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 570/1131] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:34.192370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be6950-be71-446e-a43d-f828eaa936f9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:34.192780 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be6950-be71-446e-a43d-f828eaa936f9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:34.192922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be6950-be71-446e-a43d-f828eaa936f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:34.210967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-80be6950-be71-446e-a43d-f828eaa936f9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:34.212158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-80be6950-be71-446e-a43d-f828eaa936f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:34.278466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 562/1132] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:34.301887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10c9d1-917c-4948-96bb-cf66b2acab1a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:34.398306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10c9d1-917c-4948-96bb-cf66b2acab1a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:34.431171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2356e07-483b-4e59-9c04-c946d096e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:34.431777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356e07-483b-4e59-9c04-c946d096e9db None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:34.432051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356e07-483b-4e59-9c04-c946d096e9db None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:34.432317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356e07-483b-4e59-9c04-c946d096e9db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:34.433459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2356e07-483b-4e59-9c04-c946d096e9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:34.434865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2356e07-483b-4e59-9c04-c946d096e9db None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:34.436450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 571/1133] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:34.442478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be6950-be71-446e-a43d-f828eaa936f9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:34.521397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:34.535980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be6950-be71-446e-a43d-f828eaa936f9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:34.569147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38bb15-c074-4b48-b24e-112b94e4fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:34.569777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bb15-c074-4b48-b24e-112b94e4fee8 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:34.570059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bb15-c074-4b48-b24e-112b94e4fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:34.570327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bb15-c074-4b48-b24e-112b94e4fee8 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:34.570998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38bb15-c074-4b48-b24e-112b94e4fee8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:34.572401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38bb15-c074-4b48-b24e-112b94e4fee8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:34.598091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 563/1134] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:24:34 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:24:36.600127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6ecc-0d14-49f9-ba6f-aef6c3ebe699 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:36.600649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6ecc-0d14-49f9-ba6f-aef6c3ebe699 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:36.600741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac6ecc-0d14-49f9-ba6f-aef6c3ebe699 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:36.602070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 572/1135] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:36.607336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efe0d2-4b2c-470f-b348-9d60834558ac None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:36.607753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efe0d2-4b2c-470f-b348-9d60834558ac None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:36.607884 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efe0d2-4b2c-470f-b348-9d60834558ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:36.626792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-03efe0d2-4b2c-470f-b348-9d60834558ac None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:36.628830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-03efe0d2-4b2c-470f-b348-9d60834558ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:36.699717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 564/1136] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:36.724894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6ecc-0d14-49f9-ba6f-aef6c3ebe699 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:36.773542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:36.823047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac6ecc-0d14-49f9-ba6f-aef6c3ebe699 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:36.855380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33742d1-559b-45a7-9cfe-a4a758d197d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:36.855996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33742d1-559b-45a7-9cfe-a4a758d197d4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:36.856296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33742d1-559b-45a7-9cfe-a4a758d197d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:36.856566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33742d1-559b-45a7-9cfe-a4a758d197d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:36.857714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33742d1-559b-45a7-9cfe-a4a758d197d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:36.859137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33742d1-559b-45a7-9cfe-a4a758d197d4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:36.860718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 573/1137] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:24:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:36.866506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efe0d2-4b2c-470f-b348-9d60834558ac None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:36.929999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:36.963610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efe0d2-4b2c-470f-b348-9d60834558ac None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:36.995457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba391999-c2d6-43d5-b8e5-81a878893c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:36.996057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba391999-c2d6-43d5-b8e5-81a878893c95 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:36.996334 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba391999-c2d6-43d5-b8e5-81a878893c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:36.996604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba391999-c2d6-43d5-b8e5-81a878893c95 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:36.997272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba391999-c2d6-43d5-b8e5-81a878893c95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:36.998708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba391999-c2d6-43d5-b8e5-81a878893c95 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:37.019372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 565/1138] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:24:36 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:24:39.027945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2a9d4-5f22-4d0c-abaf-08cd8e666ff5 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:39.028524 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2a9d4-5f22-4d0c-abaf-08cd8e666ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:39.028524 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2a9d4-5f22-4d0c-abaf-08cd8e666ff5 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:39.029887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 574/1139] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:39.035589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c5238-174b-4542-bb56-adc3fbfdea00 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:39.035970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c5238-174b-4542-bb56-adc3fbfdea00 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:39.036132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c5238-174b-4542-bb56-adc3fbfdea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:39.053659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e21c5238-174b-4542-bb56-adc3fbfdea00 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:39.054823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e21c5238-174b-4542-bb56-adc3fbfdea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:39.117989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 566/1140] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:39.140950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2a9d4-5f22-4d0c-abaf-08cd8e666ff5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:39.240130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2a9d4-5f22-4d0c-abaf-08cd8e666ff5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:39.255703 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:39.273558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b5490-e2f9-41b7-856b-652b2845fb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:39.274175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5490-e2f9-41b7-856b-652b2845fb92 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:39.274450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5490-e2f9-41b7-856b-652b2845fb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:39.274717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5490-e2f9-41b7-856b-652b2845fb92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:39.285121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b5490-e2f9-41b7-856b-652b2845fb92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-e34b5490-e2f9-41b7-856b-652b2845fb92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:39.289887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:39.291019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:39.292100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 575/1141] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:24:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:39.296836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c5238-174b-4542-bb56-adc3fbfdea00 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:39.349053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:39.392087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c5238-174b-4542-bb56-adc3fbfdea00 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:39.425614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73efa0-5e16-4e58-af40-ae2a6c7fbca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:39.426208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73efa0-5e16-4e58-af40-ae2a6c7fbca2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:39.426483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73efa0-5e16-4e58-af40-ae2a6c7fbca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:39.426751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73efa0-5e16-4e58-af40-ae2a6c7fbca2 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:39.427445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73efa0-5e16-4e58-af40-ae2a6c7fbca2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:39.427739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73efa0-5e16-4e58-af40-ae2a6c7fbca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:39.429077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73efa0-5e16-4e58-af40-ae2a6c7fbca2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:39.436768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 567/1142] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:24:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:39.442360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b5490-e2f9-41b7-856b-652b2845fb92 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:39.538499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b5490-e2f9-41b7-856b-652b2845fb92 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:39.570475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8898b-1391-40d8-a191-93112c7df974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:39.571097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8898b-1391-40d8-a191-93112c7df974 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:39.571376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8898b-1391-40d8-a191-93112c7df974 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:39.571651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8898b-1391-40d8-a191-93112c7df974 None admin] PATH_INFO: `/v3/users/f78e5c7a23b04a719e2fca995156b3a1` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:39.584888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8898b-1391-40d8-a191-93112c7df974 None admin] RBAC: Authorizing `identity:get_user(user_id=f78e5c7a23b04a719e2fca995156b3a1)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:39.586333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8898b-1391-40d8-a191-93112c7df974 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:39.587939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 576/1143] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:39 2022] GET /identity/v3/users/f78e5c7a23b04a719e2fca995156b3a1 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:39.593614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73efa0-5e16-4e58-af40-ae2a6c7fbca2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:39.689981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73efa0-5e16-4e58-af40-ae2a6c7fbca2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:39.705707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:39.723581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c49c29-7c15-4650-ab3c-baa1f9cf855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:39.724178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c49c29-7c15-4650-ab3c-baa1f9cf855a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:39.724454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c49c29-7c15-4650-ab3c-baa1f9cf855a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:39.724723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c49c29-7c15-4650-ab3c-baa1f9cf855a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:39.790150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c49c29-7c15-4650-ab3c-baa1f9cf855a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:39.791520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c49c29-7c15-4650-ab3c-baa1f9cf855a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:39.885308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 568/1144] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:24:39.891129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8898b-1391-40d8-a191-93112c7df974 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:39.925267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:39.988499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8898b-1391-40d8-a191-93112c7df974 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:40.020646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511708f-25e9-48f0-9966-c42a0e8178bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:40.021254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511708f-25e9-48f0-9966-c42a0e8178bb None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:40.021553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511708f-25e9-48f0-9966-c42a0e8178bb None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:40.021819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511708f-25e9-48f0-9966-c42a0e8178bb None admin] PATH_INFO: `/v3/projects/273a5369aa4c46ac818cc6642c174a39` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:40.022935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511708f-25e9-48f0-9966-c42a0e8178bb None admin] RBAC: Authorizing `identity:get_project(project_id=273a5369aa4c46ac818cc6642c174a39)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:40.024328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511708f-25e9-48f0-9966-c42a0e8178bb None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:40.025965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 577/1145] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:39 2022] GET /identity/v3/projects/273a5369aa4c46ac818cc6642c174a39 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:40.032267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c49c29-7c15-4650-ab3c-baa1f9cf855a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:40.050348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:40.129539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c49c29-7c15-4650-ab3c-baa1f9cf855a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:40.169820 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7682fd-6c18-437a-a27b-4a976fd759a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:40.170418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7682fd-6c18-437a-a27b-4a976fd759a0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:40.170696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7682fd-6c18-437a-a27b-4a976fd759a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:40.170970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7682fd-6c18-437a-a27b-4a976fd759a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:40.171742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7682fd-6c18-437a-a27b-4a976fd759a0 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=273a5369aa4c46ac818cc6642c174a39, user.id=f78e5c7a23b04a719e2fca995156b3a1) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:40.172048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7682fd-6c18-437a-a27b-4a976fd759a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:40.173490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7682fd-6c18-437a-a27b-4a976fd759a0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:40.178842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 569/1146] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:40 2022] GET /identity/v3/role_assignments?user.id=f78e5c7a23b04a719e2fca995156b3a1&scope.project.id=273a5369aa4c46ac818cc6642c174a39&role.id=999cac3070e64b82b981258349005963 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:42.107919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccec62e-6b82-426c-ae4c-57afd281ac94 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:42.108463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccec62e-6b82-426c-ae4c-57afd281ac94 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:42.108463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccec62e-6b82-426c-ae4c-57afd281ac94 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:42.109843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 578/1147] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:42.115343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c08f1-ba4f-4a0c-a2f6-bce1b5e2b254 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:42.115754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c08f1-ba4f-4a0c-a2f6-bce1b5e2b254 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:42.115889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c08f1-ba4f-4a0c-a2f6-bce1b5e2b254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:42.133488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-530c08f1-ba4f-4a0c-a2f6-bce1b5e2b254 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:42.134649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-530c08f1-ba4f-4a0c-a2f6-bce1b5e2b254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:42.206045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 570/1148] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:42.228182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccec62e-6b82-426c-ae4c-57afd281ac94 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:42.326771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccec62e-6b82-426c-ae4c-57afd281ac94 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:42.328233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:42.360743 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993277f0-c91c-4dc3-bb4e-b74563c0cabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:42.361919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993277f0-c91c-4dc3-bb4e-b74563c0cabc None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:42.362209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993277f0-c91c-4dc3-bb4e-b74563c0cabc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:42.362485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993277f0-c91c-4dc3-bb4e-b74563c0cabc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:42.372163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993277f0-c91c-4dc3-bb4e-b74563c0cabc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-993277f0-c91c-4dc3-bb4e-b74563c0cabc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:42.377055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:42.378165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:42.379192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 579/1149] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:24:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:42.384155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c08f1-ba4f-4a0c-a2f6-bce1b5e2b254 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:42.395587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:42.481043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c08f1-ba4f-4a0c-a2f6-bce1b5e2b254 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:42.512912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44acbd-f1fd-42a1-82fb-ba49fb23571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:42.513542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44acbd-f1fd-42a1-82fb-ba49fb23571d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:42.513823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44acbd-f1fd-42a1-82fb-ba49fb23571d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:42.514098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44acbd-f1fd-42a1-82fb-ba49fb23571d None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:42.514798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44acbd-f1fd-42a1-82fb-ba49fb23571d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:42.515098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44acbd-f1fd-42a1-82fb-ba49fb23571d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:42.516455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44acbd-f1fd-42a1-82fb-ba49fb23571d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:42.524748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 571/1150] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:24:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:42.530538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993277f0-c91c-4dc3-bb4e-b74563c0cabc None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:42.627891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993277f0-c91c-4dc3-bb4e-b74563c0cabc None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:42.661314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceab75f-aa3f-4b38-81da-5fd346577783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:42.661955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceab75f-aa3f-4b38-81da-5fd346577783 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:42.662237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceab75f-aa3f-4b38-81da-5fd346577783 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:42.662513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceab75f-aa3f-4b38-81da-5fd346577783 None admin] PATH_INFO: `/v3/users/f78e5c7a23b04a719e2fca995156b3a1` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:42.663671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceab75f-aa3f-4b38-81da-5fd346577783 None admin] RBAC: Authorizing `identity:get_user(user_id=f78e5c7a23b04a719e2fca995156b3a1)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:42.665096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceab75f-aa3f-4b38-81da-5fd346577783 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:42.666738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 580/1151] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:42 2022] GET /identity/v3/users/f78e5c7a23b04a719e2fca995156b3a1 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:42.672531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44acbd-f1fd-42a1-82fb-ba49fb23571d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:42.740104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:42.769541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44acbd-f1fd-42a1-82fb-ba49fb23571d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:42.802478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917a25d-fe4d-4292-9ace-bc61a3be9e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:42.803100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917a25d-fe4d-4292-9ace-bc61a3be9e4f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:42.803380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917a25d-fe4d-4292-9ace-bc61a3be9e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:42.803653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917a25d-fe4d-4292-9ace-bc61a3be9e4f None admin] PATH_INFO: `/v3/projects/273a5369aa4c46ac818cc6642c174a39` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:42.804788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917a25d-fe4d-4292-9ace-bc61a3be9e4f None admin] RBAC: Authorizing `identity:get_project(project_id=273a5369aa4c46ac818cc6642c174a39)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:42.806233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917a25d-fe4d-4292-9ace-bc61a3be9e4f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:42.807870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 572/1152] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:42 2022] GET /identity/v3/projects/273a5369aa4c46ac818cc6642c174a39 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:42.813642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceab75f-aa3f-4b38-81da-5fd346577783 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:42.843886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:42.910842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceab75f-aa3f-4b38-81da-5fd346577783 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:42.943033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86660f41-1076-4d21-8801-a825dee293d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:42.943675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86660f41-1076-4d21-8801-a825dee293d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:42.943951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86660f41-1076-4d21-8801-a825dee293d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:42.944223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86660f41-1076-4d21-8801-a825dee293d1 None admin] PATH_INFO: `/v3/projects/273a5369aa4c46ac818cc6642c174a39/users/f78e5c7a23b04a719e2fca995156b3a1/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:42.946126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86660f41-1076-4d21-8801-a825dee293d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=273a5369aa4c46ac818cc6642c174a39, user_id=f78e5c7a23b04a719e2fca995156b3a1, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:42.947522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86660f41-1076-4d21-8801-a825dee293d1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:42.960686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 581/1153] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:24:42 2022] PUT /identity/v3/projects/273a5369aa4c46ac818cc6642c174a39/users/f78e5c7a23b04a719e2fca995156b3a1/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:24:44.923218 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e6d6f-4a14-426a-be8d-05db3d813475 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:44.923708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e6d6f-4a14-426a-be8d-05db3d813475 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:44.923708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e6d6f-4a14-426a-be8d-05db3d813475 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:44.925025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 573/1154] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:44.930045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69704-ffb2-443a-922c-feca31190294 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:44.930431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69704-ffb2-443a-922c-feca31190294 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:44.930578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69704-ffb2-443a-922c-feca31190294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:44.952270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-d0d69704-ffb2-443a-922c-feca31190294 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:44.953501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d0d69704-ffb2-443a-922c-feca31190294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:45.017592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 582/1155] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:45.041598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e6d6f-4a14-426a-be8d-05db3d813475 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:45.139179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e6d6f-4a14-426a-be8d-05db3d813475 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:45.171415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89feb-46ad-4dc2-8b11-cd7f714919a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:45.172034 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89feb-46ad-4dc2-8b11-cd7f714919a5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:45.172312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89feb-46ad-4dc2-8b11-cd7f714919a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:45.172581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89feb-46ad-4dc2-8b11-cd7f714919a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:45.179865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:45.183540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a89feb-46ad-4dc2-8b11-cd7f714919a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-10a89feb-46ad-4dc2-8b11-cd7f714919a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:45.188575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:45.189699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:45.191255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 574/1156] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:45.196258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69704-ffb2-443a-922c-feca31190294 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:45.217148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:45.293476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69704-ffb2-443a-922c-feca31190294 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:45.325606 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73376aee-22ab-423a-8a81-821e0ea1ae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:45.326202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73376aee-22ab-423a-8a81-821e0ea1ae1c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:45.326478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73376aee-22ab-423a-8a81-821e0ea1ae1c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:45.326745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73376aee-22ab-423a-8a81-821e0ea1ae1c None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:45.327438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73376aee-22ab-423a-8a81-821e0ea1ae1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:45.327732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73376aee-22ab-423a-8a81-821e0ea1ae1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:45.329072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73376aee-22ab-423a-8a81-821e0ea1ae1c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:45.337409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 583/1157] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:24:45.343063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89feb-46ad-4dc2-8b11-cd7f714919a5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:45.439202 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89feb-46ad-4dc2-8b11-cd7f714919a5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:45.471290 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ea248-3e98-45b4-814c-446a695c4958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:45.471903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ea248-3e98-45b4-814c-446a695c4958 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:45.472182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ea248-3e98-45b4-814c-446a695c4958 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:45.472455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ea248-3e98-45b4-814c-446a695c4958 None admin] PATH_INFO: `/v3/users/f78e5c7a23b04a719e2fca995156b3a1` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:45.473601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ea248-3e98-45b4-814c-446a695c4958 None admin] RBAC: Authorizing `identity:get_user(user_id=f78e5c7a23b04a719e2fca995156b3a1)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:45.475028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ea248-3e98-45b4-814c-446a695c4958 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:45.476579 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 575/1158] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:45 2022] GET /identity/v3/users/f78e5c7a23b04a719e2fca995156b3a1 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:45.482039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73376aee-22ab-423a-8a81-821e0ea1ae1c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:45.561553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:45.579994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73376aee-22ab-423a-8a81-821e0ea1ae1c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:45.612660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27478651-4b11-4d0b-90eb-792bd8a07a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:45.613255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27478651-4b11-4d0b-90eb-792bd8a07a8f None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:45.613557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27478651-4b11-4d0b-90eb-792bd8a07a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:45.613832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27478651-4b11-4d0b-90eb-792bd8a07a8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:45.677549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27478651-4b11-4d0b-90eb-792bd8a07a8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:45.678961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27478651-4b11-4d0b-90eb-792bd8a07a8f None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:45.754809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:45.773505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 584/1159] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:24:45.779671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ea248-3e98-45b4-814c-446a695c4958 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:45.844507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:45.877241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ea248-3e98-45b4-814c-446a695c4958 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:45.910857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac93d83-b9c7-479b-a286-1535108da443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:45.911468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac93d83-b9c7-479b-a286-1535108da443 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:45.911745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac93d83-b9c7-479b-a286-1535108da443 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:45.912017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac93d83-b9c7-479b-a286-1535108da443 None admin] PATH_INFO: `/v3/projects/273a5369aa4c46ac818cc6642c174a39` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:45.913129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac93d83-b9c7-479b-a286-1535108da443 None admin] RBAC: Authorizing `identity:get_project(project_id=273a5369aa4c46ac818cc6642c174a39)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:45.914570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac93d83-b9c7-479b-a286-1535108da443 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:45.916179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 576/1160] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:45 2022] GET /identity/v3/projects/273a5369aa4c46ac818cc6642c174a39 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:45.922167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27478651-4b11-4d0b-90eb-792bd8a07a8f None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:46.016663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27478651-4b11-4d0b-90eb-792bd8a07a8f None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:46.048963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710da904-4655-43d4-af97-40fe09e93c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:46.049605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da904-4655-43d4-af97-40fe09e93c02 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:46.049890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da904-4655-43d4-af97-40fe09e93c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:46.050143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da904-4655-43d4-af97-40fe09e93c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:46.050914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710da904-4655-43d4-af97-40fe09e93c02 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=273a5369aa4c46ac818cc6642c174a39, user.id=f78e5c7a23b04a719e2fca995156b3a1) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:46.051217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710da904-4655-43d4-af97-40fe09e93c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:46.052607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710da904-4655-43d4-af97-40fe09e93c02 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:46.058152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 585/1161] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:45 2022] GET /identity/v3/role_assignments?user.id=f78e5c7a23b04a719e2fca995156b3a1&scope.project.id=273a5369aa4c46ac818cc6642c174a39&role.id=999cac3070e64b82b981258349005963 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:48.031796 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127dcaa-e077-409c-8bcb-39f2f383e1e7 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:48.032415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127dcaa-e077-409c-8bcb-39f2f383e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:48.032415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127dcaa-e077-409c-8bcb-39f2f383e1e7 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:48.033744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 577/1162] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:48.038719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef33fe2-6660-4b20-ae4d-1fe17193c521 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:48.039088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef33fe2-6660-4b20-ae4d-1fe17193c521 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:48.039260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef33fe2-6660-4b20-ae4d-1fe17193c521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:48.057228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-cef33fe2-6660-4b20-ae4d-1fe17193c521 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:48.058414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-cef33fe2-6660-4b20-ae4d-1fe17193c521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:48.099178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:48.123334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 586/1163] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:48.144527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127dcaa-e077-409c-8bcb-39f2f383e1e7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:48.242824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127dcaa-e077-409c-8bcb-39f2f383e1e7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:48.274139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39435c-da8d-41b3-b5e9-866f2b5926a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:48.274732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39435c-da8d-41b3-b5e9-866f2b5926a9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:48.275008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39435c-da8d-41b3-b5e9-866f2b5926a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:48.275277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39435c-da8d-41b3-b5e9-866f2b5926a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:48.278817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:48.341093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39435c-da8d-41b3-b5e9-866f2b5926a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:48.342496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39435c-da8d-41b3-b5e9-866f2b5926a9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:48.439014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 578/1164] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:24:48.444886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef33fe2-6660-4b20-ae4d-1fe17193c521 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:48.539560 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef33fe2-6660-4b20-ae4d-1fe17193c521 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:48.571655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9e00-5d49-4192-b28c-f88d10557d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:48.572328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9e00-5d49-4192-b28c-f88d10557d18 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:48.572606 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9e00-5d49-4192-b28c-f88d10557d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:48.573226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9e00-5d49-4192-b28c-f88d10557d18 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:48.579407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd9e00-5d49-4192-b28c-f88d10557d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:48.581357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd9e00-5d49-4192-b28c-f88d10557d18 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-a5fd9e00-5d49-4192-b28c-f88d10557d18 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:48.592435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:48.593643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:24:48.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 587/1165] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:24:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:24:48.599974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39435c-da8d-41b3-b5e9-866f2b5926a9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:48.632635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:48.695479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39435c-da8d-41b3-b5e9-866f2b5926a9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:48.728848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e638469-574a-48e6-96ff-45b0eb45bedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:48.729487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e638469-574a-48e6-96ff-45b0eb45bedd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:48.729769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e638469-574a-48e6-96ff-45b0eb45bedd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:48.730049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e638469-574a-48e6-96ff-45b0eb45bedd None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:48.730728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e638469-574a-48e6-96ff-45b0eb45bedd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:48.731028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e638469-574a-48e6-96ff-45b0eb45bedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:48.732376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e638469-574a-48e6-96ff-45b0eb45bedd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:48.739843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 579/1166] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Aug 4 02:24:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:50.708120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e683f49-cd39-4956-8c73-3f3290bffa2b None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:50.708611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e683f49-cd39-4956-8c73-3f3290bffa2b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:50.708721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e683f49-cd39-4956-8c73-3f3290bffa2b None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:50.710072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 588/1167] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:50.715226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0010ee-9814-4667-a192-a974afcee9f9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:50.715614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0010ee-9814-4667-a192-a974afcee9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:50.715773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0010ee-9814-4667-a192-a974afcee9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:50.733199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9d0010ee-9814-4667-a192-a974afcee9f9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:50.734412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9d0010ee-9814-4667-a192-a974afcee9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:50.798519 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 580/1168] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:50.821550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e683f49-cd39-4956-8c73-3f3290bffa2b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:50.857302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:50.920917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e683f49-cd39-4956-8c73-3f3290bffa2b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:50.953106 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b5319-e590-4534-9dee-06879d5d9014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:50.953724 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b5319-e590-4534-9dee-06879d5d9014 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:50.953999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b5319-e590-4534-9dee-06879d5d9014 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:50.954265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b5319-e590-4534-9dee-06879d5d9014 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:50.954966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b5319-e590-4534-9dee-06879d5d9014 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:50.956305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b5319-e590-4534-9dee-06879d5d9014 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:50.971198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 589/1169] 10.222.0.69 () {60 vars in 1138 bytes} [Thu Aug 4 02:24:50 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:24:52.957703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3c30-cee2-4d71-8b3d-096bb8101dee None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:52.958256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3c30-cee2-4d71-8b3d-096bb8101dee None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:52.958256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e3c30-cee2-4d71-8b3d-096bb8101dee None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:52.959597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 581/1170] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:52.964602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f2d26-eeb3-4cd8-a9ed-b329f31a9592 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:52.964979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f2d26-eeb3-4cd8-a9ed-b329f31a9592 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:52.965145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f2d26-eeb3-4cd8-a9ed-b329f31a9592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:52.983292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e52f2d26-eeb3-4cd8-a9ed-b329f31a9592 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:52.984450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e52f2d26-eeb3-4cd8-a9ed-b329f31a9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:53.047450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 590/1171] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:53.069455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3c30-cee2-4d71-8b3d-096bb8101dee None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:53.099730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:53.169463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e3c30-cee2-4d71-8b3d-096bb8101dee None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:53.201861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20dc35-ab48-435f-ba50-e4bd076b9229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:53.202480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20dc35-ab48-435f-ba50-e4bd076b9229 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:53.202761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20dc35-ab48-435f-ba50-e4bd076b9229 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:53.203032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20dc35-ab48-435f-ba50-e4bd076b9229 None admin] PATH_INFO: `/v3/domains/f0b205af45da44849fddac1e9cddd176` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:53.213770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20dc35-ab48-435f-ba50-e4bd076b9229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0b205af45da44849fddac1e9cddd176)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:53.215149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20dc35-ab48-435f-ba50-e4bd076b9229 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:53.216738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 582/1172] 10.222.0.69 () {56 vars in 1183 bytes} [Thu Aug 4 02:24:53 2022] GET /identity/v3/domains/f0b205af45da44849fddac1e9cddd176 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:53.223095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f2d26-eeb3-4cd8-a9ed-b329f31a9592 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:53.251310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:53.321670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f2d26-eeb3-4cd8-a9ed-b329f31a9592 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:53.353783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf569187-02c6-40e4-a97b-0fc491c4a0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:53.354379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf569187-02c6-40e4-a97b-0fc491c4a0dc None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:53.354652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf569187-02c6-40e4-a97b-0fc491c4a0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:53.354918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf569187-02c6-40e4-a97b-0fc491c4a0dc None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:53.355615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf569187-02c6-40e4-a97b-0fc491c4a0dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:53.357015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf569187-02c6-40e4-a97b-0fc491c4a0dc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:53.382155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 591/1173] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:24:53 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:24:55.371280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac1ee-f31b-4ce3-ac06-33c9bdbdd2c5 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:55.371808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac1ee-f31b-4ce3-ac06-33c9bdbdd2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:55.371894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac1ee-f31b-4ce3-ac06-33c9bdbdd2c5 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:55.373197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 583/1174] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:55.378986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cdeaa-c299-4264-8fbc-8f02d4e46ca4 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:55.379433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cdeaa-c299-4264-8fbc-8f02d4e46ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:55.379528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cdeaa-c299-4264-8fbc-8f02d4e46ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:55.397010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b05cdeaa-c299-4264-8fbc-8f02d4e46ca4 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:55.398199 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b05cdeaa-c299-4264-8fbc-8f02d4e46ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:55.461019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 592/1175] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:24:55.484847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ac1ee-f31b-4ce3-ac06-33c9bdbdd2c5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:55.575310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:55.585720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ac1ee-f31b-4ce3-ac06-33c9bdbdd2c5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:55.618381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5a69c-9e45-44ae-b060-36cae29240c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:55.619000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5a69c-9e45-44ae-b060-36cae29240c5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:55.619276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5a69c-9e45-44ae-b060-36cae29240c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:55.619544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5a69c-9e45-44ae-b060-36cae29240c5 None admin] PATH_INFO: `/v3/domains/f0b205af45da44849fddac1e9cddd176` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:55.620660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5a69c-9e45-44ae-b060-36cae29240c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0b205af45da44849fddac1e9cddd176)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:55.622144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5a69c-9e45-44ae-b060-36cae29240c5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:55.623655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 584/1176] 10.222.0.69 () {56 vars in 1183 bytes} [Thu Aug 4 02:24:55 2022] GET /identity/v3/domains/f0b205af45da44849fddac1e9cddd176 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:55.629368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cdeaa-c299-4264-8fbc-8f02d4e46ca4 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:55.639304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:55.724722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cdeaa-c299-4264-8fbc-8f02d4e46ca4 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:55.757205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff43376-cb51-4a77-ae82-aab80bce26be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:55.757820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff43376-cb51-4a77-ae82-aab80bce26be None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:55.758095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff43376-cb51-4a77-ae82-aab80bce26be None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:55.758364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff43376-cb51-4a77-ae82-aab80bce26be None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:55.759039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff43376-cb51-4a77-ae82-aab80bce26be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:55.760511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff43376-cb51-4a77-ae82-aab80bce26be None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:55.781348 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 593/1177] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:24:55 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:24:57.791864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388fbb6-799c-4d39-80e6-5da16e549d88 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:57.792429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388fbb6-799c-4d39-80e6-5da16e549d88 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:57.792429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388fbb6-799c-4d39-80e6-5da16e549d88 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:57.793799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 585/1178] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:24:57.798893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f400e-c6dd-40ce-bd59-e9df4623d93e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:57.799345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f400e-c6dd-40ce-bd59-e9df4623d93e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:57.799445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f400e-c6dd-40ce-bd59-e9df4623d93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:57.817299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f26f400e-c6dd-40ce-bd59-e9df4623d93e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:24:57.818481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f26f400e-c6dd-40ce-bd59-e9df4623d93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:24:57.873795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:57.883218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 594/1179] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:24:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:24:57.906361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388fbb6-799c-4d39-80e6-5da16e549d88 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:58.004550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388fbb6-799c-4d39-80e6-5da16e549d88 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:58.037546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff8058-454b-4550-842a-1bf829f1520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:58.038164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff8058-454b-4550-842a-1bf829f1520d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:58.038445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff8058-454b-4550-842a-1bf829f1520d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:58.038717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff8058-454b-4550-842a-1bf829f1520d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:58.050019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff8058-454b-4550-842a-1bf829f1520d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4cff8058-454b-4550-842a-1bf829f1520d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:24:58.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:24:58.056039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:24:58.057258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 586/1180] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:24:58.061866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f400e-c6dd-40ce-bd59-e9df4623d93e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:58.156154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f400e-c6dd-40ce-bd59-e9df4623d93e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:58.188887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81b616-55b0-4ec7-959e-4ea98e78ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:58.189530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81b616-55b0-4ec7-959e-4ea98e78ee37 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:58.189808 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81b616-55b0-4ec7-959e-4ea98e78ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:58.190076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81b616-55b0-4ec7-959e-4ea98e78ee37 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:58.190771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81b616-55b0-4ec7-959e-4ea98e78ee37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:58.191065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81b616-55b0-4ec7-959e-4ea98e78ee37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:58.192401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81b616-55b0-4ec7-959e-4ea98e78ee37 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:58.200092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 595/1181] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:58.206103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff8058-454b-4550-842a-1bf829f1520d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:58.225276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:58.304057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff8058-454b-4550-842a-1bf829f1520d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:58.336406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94f84-c860-4d95-9021-6e73cc895ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:58.337029 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94f84-c860-4d95-9021-6e73cc895ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:58.337304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94f84-c860-4d95-9021-6e73cc895ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:58.337600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94f84-c860-4d95-9021-6e73cc895ba4 None admin] PATH_INFO: `/v3/users/f229ccf876584b08b131efa16a3b08dc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:58.351058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d94f84-c860-4d95-9021-6e73cc895ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=f229ccf876584b08b131efa16a3b08dc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:58.352480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d94f84-c860-4d95-9021-6e73cc895ba4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:58.354115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 587/1182] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:24:58 2022] GET /identity/v3/users/f229ccf876584b08b131efa16a3b08dc => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:58.359837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81b616-55b0-4ec7-959e-4ea98e78ee37 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:58.414479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:58.456835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81b616-55b0-4ec7-959e-4ea98e78ee37 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:58.489050 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb49a9-2a60-40f2-a339-50999d763d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:58.489668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb49a9-2a60-40f2-a339-50999d763d30 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:58.489947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb49a9-2a60-40f2-a339-50999d763d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:58.490218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb49a9-2a60-40f2-a339-50999d763d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:58.554777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb49a9-2a60-40f2-a339-50999d763d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:58.556222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb49a9-2a60-40f2-a339-50999d763d30 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:58.609138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:58.652926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 596/1183] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:24:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:24:58.658848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94f84-c860-4d95-9021-6e73cc895ba4 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:58.731831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:24:58.754537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94f84-c860-4d95-9021-6e73cc895ba4 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:58.787078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8982bad-079c-4357-a66c-72ccb4b68e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:58.787689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982bad-079c-4357-a66c-72ccb4b68e2b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:58.787964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982bad-079c-4357-a66c-72ccb4b68e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:58.788234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982bad-079c-4357-a66c-72ccb4b68e2b None admin] PATH_INFO: `/v3/projects/b68dd95c9a7b486f86a51839252fddad` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:58.789369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8982bad-079c-4357-a66c-72ccb4b68e2b None admin] RBAC: Authorizing `identity:get_project(project_id=b68dd95c9a7b486f86a51839252fddad)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:58.790786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8982bad-079c-4357-a66c-72ccb4b68e2b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:58.792401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 588/1184] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:24:58 2022] GET /identity/v3/projects/b68dd95c9a7b486f86a51839252fddad => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:24:58.798418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb49a9-2a60-40f2-a339-50999d763d30 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:24:58.893381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb49a9-2a60-40f2-a339-50999d763d30 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:24:58.926582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6000c9-3c22-48ed-b4ee-b35a41d96d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:24:58.927172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6000c9-3c22-48ed-b4ee-b35a41d96d51 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:24:58.927449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6000c9-3c22-48ed-b4ee-b35a41d96d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:24:58.927720 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6000c9-3c22-48ed-b4ee-b35a41d96d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:24:58.928492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6000c9-3c22-48ed-b4ee-b35a41d96d51 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=b68dd95c9a7b486f86a51839252fddad, user.id=f229ccf876584b08b131efa16a3b08dc) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:24:58.928797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6000c9-3c22-48ed-b4ee-b35a41d96d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:24:58.930213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6000c9-3c22-48ed-b4ee-b35a41d96d51 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:24:58.935378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 597/1185] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:24:58 2022] GET /identity/v3/role_assignments?user.id=f229ccf876584b08b131efa16a3b08dc&scope.project.id=b68dd95c9a7b486f86a51839252fddad&role.id=999cac3070e64b82b981258349005963 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:25:00.875900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e218-6d7c-40da-952e-af8083246ae1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:00.876404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e218-6d7c-40da-952e-af8083246ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:00.876404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e218-6d7c-40da-952e-af8083246ae1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:00.878233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 589/1186] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:25:00.883387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba739e-ea54-49df-8bc1-02f95f7a0b06 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:00.883828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba739e-ea54-49df-8bc1-02f95f7a0b06 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:00.883928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba739e-ea54-49df-8bc1-02f95f7a0b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:00.902342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-0bba739e-ea54-49df-8bc1-02f95f7a0b06 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:25:00.903517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0bba739e-ea54-49df-8bc1-02f95f7a0b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:25:00.917055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:00.968093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 598/1187] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:25:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:25:00.989800 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e218-6d7c-40da-952e-af8083246ae1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:01.087473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e218-6d7c-40da-952e-af8083246ae1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:01.120049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70ec46-51dd-4c21-ab47-61a7c24c2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:01.120656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70ec46-51dd-4c21-ab47-61a7c24c2340 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:01.120932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70ec46-51dd-4c21-ab47-61a7c24c2340 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:01.121201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70ec46-51dd-4c21-ab47-61a7c24c2340 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:01.130829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70ec46-51dd-4c21-ab47-61a7c24c2340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0f70ec46-51dd-4c21-ab47-61a7c24c2340 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:25:01.135548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:25:01.136621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:25:01.137846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 590/1188] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:25:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:25:01.142523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba739e-ea54-49df-8bc1-02f95f7a0b06 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:01.237264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba739e-ea54-49df-8bc1-02f95f7a0b06 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:01.270323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7a5d-7537-4073-b969-9bd84ffa0016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:01.270915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7a5d-7537-4073-b969-9bd84ffa0016 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:01.271191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7a5d-7537-4073-b969-9bd84ffa0016 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:01.271459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f7a5d-7537-4073-b969-9bd84ffa0016 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:01.272190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f7a5d-7537-4073-b969-9bd84ffa0016 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:25:01.272488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f7a5d-7537-4073-b969-9bd84ffa0016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:01.273870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f7a5d-7537-4073-b969-9bd84ffa0016 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:01.281863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 599/1189] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:25:01.287457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70ec46-51dd-4c21-ab47-61a7c24c2340 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:01.291630 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:01.386514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70ec46-51dd-4c21-ab47-61a7c24c2340 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:01.419012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d64ef4-d783-4b71-b75d-03024105bfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:01.419629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d64ef4-d783-4b71-b75d-03024105bfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:01.419908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d64ef4-d783-4b71-b75d-03024105bfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:01.420181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d64ef4-d783-4b71-b75d-03024105bfe8 None admin] PATH_INFO: `/v3/users/f229ccf876584b08b131efa16a3b08dc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:01.421311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d64ef4-d783-4b71-b75d-03024105bfe8 None admin] RBAC: Authorizing `identity:get_user(user_id=f229ccf876584b08b131efa16a3b08dc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:01.422785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d64ef4-d783-4b71-b75d-03024105bfe8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:01.424914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 591/1190] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:25:01 2022] GET /identity/v3/users/f229ccf876584b08b131efa16a3b08dc => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:25:01.430717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7a5d-7537-4073-b969-9bd84ffa0016 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:01.445912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:01.527100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f7a5d-7537-4073-b969-9bd84ffa0016 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:01.559476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd8af-392c-4cb6-8bca-0a9ff49fdfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:01.560099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd8af-392c-4cb6-8bca-0a9ff49fdfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:01.560381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd8af-392c-4cb6-8bca-0a9ff49fdfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:01.560650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd8af-392c-4cb6-8bca-0a9ff49fdfc6 None admin] PATH_INFO: `/v3/projects/b68dd95c9a7b486f86a51839252fddad` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:01.561805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacd8af-392c-4cb6-8bca-0a9ff49fdfc6 None admin] RBAC: Authorizing `identity:get_project(project_id=b68dd95c9a7b486f86a51839252fddad)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:01.563219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacd8af-392c-4cb6-8bca-0a9ff49fdfc6 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:01.565437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 600/1191] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:25:01 2022] GET /identity/v3/projects/b68dd95c9a7b486f86a51839252fddad => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:25:01.571314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d64ef4-d783-4b71-b75d-03024105bfe8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:01.638994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:01.667712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d64ef4-d783-4b71-b75d-03024105bfe8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:01.700924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94300ca2-b6e7-4e8c-8497-86d6e0011688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:01.701598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94300ca2-b6e7-4e8c-8497-86d6e0011688 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:01.701875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94300ca2-b6e7-4e8c-8497-86d6e0011688 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:01.702145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94300ca2-b6e7-4e8c-8497-86d6e0011688 None admin] PATH_INFO: `/v3/projects/b68dd95c9a7b486f86a51839252fddad/users/f229ccf876584b08b131efa16a3b08dc/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:01.704019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94300ca2-b6e7-4e8c-8497-86d6e0011688 None admin] RBAC: Authorizing `identity:create_grant(project_id=b68dd95c9a7b486f86a51839252fddad, user_id=f229ccf876584b08b131efa16a3b08dc, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:01.705492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94300ca2-b6e7-4e8c-8497-86d6e0011688 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:01.717998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 592/1192] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:25:01 2022] PUT /identity/v3/projects/b68dd95c9a7b486f86a51839252fddad/users/f229ccf876584b08b131efa16a3b08dc/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:25:03.651340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f345a-ac1b-4a53-8e5c-838a24c4491b None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:03.651814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f345a-ac1b-4a53-8e5c-838a24c4491b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:03.651910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f345a-ac1b-4a53-8e5c-838a24c4491b None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:03.653270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 601/1193] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:25:03.659008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33cf1-b970-4551-8353-87d169cb61cb None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:03.659419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33cf1-b970-4551-8353-87d169cb61cb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:03.659546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c33cf1-b970-4551-8353-87d169cb61cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:03.676936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e6c33cf1-b970-4551-8353-87d169cb61cb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:25:03.678137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e6c33cf1-b970-4551-8353-87d169cb61cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:25:03.742491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 593/1194] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:25:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:25:03.765402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f345a-ac1b-4a53-8e5c-838a24c4491b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:03.844696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:03.865466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f345a-ac1b-4a53-8e5c-838a24c4491b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:03.897030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c21565-1483-4f3b-9903-b32080e426fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:03.897679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c21565-1483-4f3b-9903-b32080e426fe None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:03.897961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c21565-1483-4f3b-9903-b32080e426fe None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:03.898236 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c21565-1483-4f3b-9903-b32080e426fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:03.909203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c21565-1483-4f3b-9903-b32080e426fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-e9c21565-1483-4f3b-9903-b32080e426fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:25:03.914074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:25:03.915162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:25:03.916207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 602/1195] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:25:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:25:03.921113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c33cf1-b970-4551-8353-87d169cb61cb None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:03.979528 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:04.017079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c33cf1-b970-4551-8353-87d169cb61cb None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:04.050099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3c493-9024-4380-8a2c-15f4e27a7126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:04.050690 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3c493-9024-4380-8a2c-15f4e27a7126 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:04.050969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3c493-9024-4380-8a2c-15f4e27a7126 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:04.051236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3c493-9024-4380-8a2c-15f4e27a7126 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:04.051930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3c493-9024-4380-8a2c-15f4e27a7126 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:25:04.052225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3c493-9024-4380-8a2c-15f4e27a7126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:04.053597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3c493-9024-4380-8a2c-15f4e27a7126 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:04.061290 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 594/1196] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:25:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:25:04.067080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c21565-1483-4f3b-9903-b32080e426fe None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:04.163843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c21565-1483-4f3b-9903-b32080e426fe None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:04.196087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87229c9-afe4-4a1a-a181-ddbf6c861a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:04.196698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87229c9-afe4-4a1a-a181-ddbf6c861a0b None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:04.196972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87229c9-afe4-4a1a-a181-ddbf6c861a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:04.197244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87229c9-afe4-4a1a-a181-ddbf6c861a0b None admin] PATH_INFO: `/v3/users/f229ccf876584b08b131efa16a3b08dc` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:04.198397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87229c9-afe4-4a1a-a181-ddbf6c861a0b None admin] RBAC: Authorizing `identity:get_user(user_id=f229ccf876584b08b131efa16a3b08dc)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:04.199827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87229c9-afe4-4a1a-a181-ddbf6c861a0b None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:04.201572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 603/1197] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Aug 4 02:25:04 2022] GET /identity/v3/users/f229ccf876584b08b131efa16a3b08dc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:25:04.207457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3c493-9024-4380-8a2c-15f4e27a7126 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:04.309270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3c493-9024-4380-8a2c-15f4e27a7126 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:04.331480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:04.342003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda632e-f51e-4ac4-82fb-13b05c3f2203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:04.342607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda632e-f51e-4ac4-82fb-13b05c3f2203 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:04.342882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda632e-f51e-4ac4-82fb-13b05c3f2203 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:04.343152 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda632e-f51e-4ac4-82fb-13b05c3f2203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:04.408266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda632e-f51e-4ac4-82fb-13b05c3f2203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:04.410250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda632e-f51e-4ac4-82fb-13b05c3f2203 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:04.503432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 595/1198] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:25:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:25:04.509283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87229c9-afe4-4a1a-a181-ddbf6c861a0b None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:04.520725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:04.607446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87229c9-afe4-4a1a-a181-ddbf6c861a0b None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:04.639506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d0f73-f728-4dea-b382-9fb9f75c5623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:04.640128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d0f73-f728-4dea-b382-9fb9f75c5623 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:04.640406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d0f73-f728-4dea-b382-9fb9f75c5623 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:04.640680 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d0f73-f728-4dea-b382-9fb9f75c5623 None admin] PATH_INFO: `/v3/projects/b68dd95c9a7b486f86a51839252fddad` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:04.641840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d0f73-f728-4dea-b382-9fb9f75c5623 None admin] RBAC: Authorizing `identity:get_project(project_id=b68dd95c9a7b486f86a51839252fddad)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:04.643879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d0f73-f728-4dea-b382-9fb9f75c5623 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:04.645535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 604/1199] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Aug 4 02:25:04 2022] GET /identity/v3/projects/b68dd95c9a7b486f86a51839252fddad => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:25:04.651841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda632e-f51e-4ac4-82fb-13b05c3f2203 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:04.675109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:04.745963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda632e-f51e-4ac4-82fb-13b05c3f2203 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:04.778920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a89bec-f490-47d9-b751-6c090b61aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:04.779455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89bec-f490-47d9-b751-6c090b61aa58 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:04.779728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89bec-f490-47d9-b751-6c090b61aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:04.779994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a89bec-f490-47d9-b751-6c090b61aa58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:04.780761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a89bec-f490-47d9-b751-6c090b61aa58 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=b68dd95c9a7b486f86a51839252fddad, user.id=f229ccf876584b08b131efa16a3b08dc) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:25:04.781064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a89bec-f490-47d9-b751-6c090b61aa58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:04.782522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a89bec-f490-47d9-b751-6c090b61aa58 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:04.788142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 596/1200] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:25:04 2022] GET /identity/v3/role_assignments?user.id=f229ccf876584b08b131efa16a3b08dc&scope.project.id=b68dd95c9a7b486f86a51839252fddad&role.id=999cac3070e64b82b981258349005963 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:25:14.635487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=62 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:14.785596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=56 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:59.229987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c0c5c-6e5e-4217-96c7-2433a8c0d8a3 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:59.230655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c0c5c-6e5e-4217-96c7-2433a8c0d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:59.230655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c0c5c-6e5e-4217-96c7-2433a8c0d8a3 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:59.231979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 605/1201] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:25:59.239232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c0f52-9819-4c53-85d2-104fb6aec5ae None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:59.239701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c0f52-9819-4c53-85d2-104fb6aec5ae None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:59.239789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c0f52-9819-4c53-85d2-104fb6aec5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:59.269396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e82c0f52-9819-4c53-85d2-104fb6aec5ae None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:25:59.270711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e82c0f52-9819-4c53-85d2-104fb6aec5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:25:59.355737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 597/1202] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:25:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:25:59.382334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c0c5c-6e5e-4217-96c7-2433a8c0d8a3 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:59.512275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c0c5c-6e5e-4217-96c7-2433a8c0d8a3 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:59.562003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b85c2-e790-4c0c-b899-dd600b847b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:59.562822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b85c2-e790-4c0c-b899-dd600b847b08 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:59.563264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b85c2-e790-4c0c-b899-dd600b847b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:59.563658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b85c2-e790-4c0c-b899-dd600b847b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:59.578295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b85c2-e790-4c0c-b899-dd600b847b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:59.580013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b85c2-e790-4c0c-b899-dd600b847b08 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-f11b85c2-e790-4c0c-b899-dd600b847b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:25:59.597376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:25:59.598557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:25:59.599515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:25:59.599515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:25:59.599515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:25:59.599515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:25:59.599515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 606/1203] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:25:59.606220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c0f52-9819-4c53-85d2-104fb6aec5ae None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:59.765463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c0f52-9819-4c53-85d2-104fb6aec5ae None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:25:59.809511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:59.814562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8135-ea9d-4878-81ca-3e4617c8cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:25:59.815552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8135-ea9d-4878-81ca-3e4617c8cf78 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:25:59.816029 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8135-ea9d-4878-81ca-3e4617c8cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:25:59.816493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8135-ea9d-4878-81ca-3e4617c8cf78 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:25:59.817185 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8135-ea9d-4878-81ca-3e4617c8cf78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:25:59.817508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8135-ea9d-4878-81ca-3e4617c8cf78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:25:59.819379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8135-ea9d-4878-81ca-3e4617c8cf78 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:25:59.834479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 598/1204] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:25:59.840828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b85c2-e790-4c0c-b899-dd600b847b08 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:25:59.913236 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:25:59.975748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b85c2-e790-4c0c-b899-dd600b847b08 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:00.016310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62e1e1-052c-4115-a27b-8d7eeae4a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:00.016905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e1e1-052c-4115-a27b-8d7eeae4a61e None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:00.017185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e1e1-052c-4115-a27b-8d7eeae4a61e None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:00.017567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e1e1-052c-4115-a27b-8d7eeae4a61e None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:00.018254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62e1e1-052c-4115-a27b-8d7eeae4a61e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:00.019757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62e1e1-052c-4115-a27b-8d7eeae4a61e None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:00.046362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 607/1205] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Aug 4 02:25:59 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:26:02.209831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364153a-58a1-4f78-ba10-cbe087eb89fd None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:02.210382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364153a-58a1-4f78-ba10-cbe087eb89fd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:02.210382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364153a-58a1-4f78-ba10-cbe087eb89fd None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:02.211739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 599/1206] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:26:02.217296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44a2e-f876-4f73-adc8-e35a987e0881 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:02.218423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44a2e-f876-4f73-adc8-e35a987e0881 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:02.218515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44a2e-f876-4f73-adc8-e35a987e0881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:02.236726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2ac44a2e-f876-4f73-adc8-e35a987e0881 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:02.237981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2ac44a2e-f876-4f73-adc8-e35a987e0881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:02.329638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 608/1207] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:26:02.344975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364153a-58a1-4f78-ba10-cbe087eb89fd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:02.473844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364153a-58a1-4f78-ba10-cbe087eb89fd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:02.510292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90307-5239-4c02-959a-92dff34609ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:02.510967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90307-5239-4c02-959a-92dff34609ef None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:02.511238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90307-5239-4c02-959a-92dff34609ef None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:02.511524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90307-5239-4c02-959a-92dff34609ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:02.530909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b90307-5239-4c02-959a-92dff34609ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-e8b90307-5239-4c02-959a-92dff34609ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:26:02.535894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:02.536903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:02.538078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 600/1208] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:26:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:02.544935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44a2e-f876-4f73-adc8-e35a987e0881 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:02.599299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:02.678896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44a2e-f876-4f73-adc8-e35a987e0881 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:02.729745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b52d7-8498-413b-8100-3280d0709bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:02.730742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b52d7-8498-413b-8100-3280d0709bfc None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:02.731181 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b52d7-8498-413b-8100-3280d0709bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:02.731731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b52d7-8498-413b-8100-3280d0709bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:02.732524 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b52d7-8498-413b-8100-3280d0709bfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:02.732834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b52d7-8498-413b-8100-3280d0709bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:02.734839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b52d7-8498-413b-8100-3280d0709bfc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:02.744493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 609/1209] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:26:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:26:02.751149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90307-5239-4c02-959a-92dff34609ef None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:02.807705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:02.864471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90307-5239-4c02-959a-92dff34609ef None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:02.901573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba5e44-4942-431b-93ab-bae0e46ae409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:02.902216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba5e44-4942-431b-93ab-bae0e46ae409 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:02.902496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba5e44-4942-431b-93ab-bae0e46ae409 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:02.902864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba5e44-4942-431b-93ab-bae0e46ae409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:02.916818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba5e44-4942-431b-93ab-bae0e46ae409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:02.918558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba5e44-4942-431b-93ab-bae0e46ae409 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-8dba5e44-4942-431b-93ab-bae0e46ae409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:02.934412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:02.935368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:02.936438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:02.936438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:02.936438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:02.936438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:02.941106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 601/1210] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:02.942204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b52d7-8498-413b-8100-3280d0709bfc None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:03.060739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:03.065457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b52d7-8498-413b-8100-3280d0709bfc None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:03.116902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37431c5-6f43-4bfe-b535-16c003407acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:03.118273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37431c5-6f43-4bfe-b535-16c003407acc None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:03.118273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37431c5-6f43-4bfe-b535-16c003407acc None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:03.118273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37431c5-6f43-4bfe-b535-16c003407acc None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:03.118982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37431c5-6f43-4bfe-b535-16c003407acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:03.119390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37431c5-6f43-4bfe-b535-16c003407acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:03.120843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37431c5-6f43-4bfe-b535-16c003407acc None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:03.136719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 610/1211] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:03.142479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba5e44-4942-431b-93ab-bae0e46ae409 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:03.257559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba5e44-4942-431b-93ab-bae0e46ae409 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:03.259118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:03.296953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0b064-7c29-41ad-8d7b-5da40e85dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:03.297647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0b064-7c29-41ad-8d7b-5da40e85dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:03.297903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0b064-7c29-41ad-8d7b-5da40e85dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:03.298170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0b064-7c29-41ad-8d7b-5da40e85dfe0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:03.307998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0b064-7c29-41ad-8d7b-5da40e85dfe0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:03.309536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0b064-7c29-41ad-8d7b-5da40e85dfe0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-fea0b064-7c29-41ad-8d7b-5da40e85dfe0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:26:03.323974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:03.325263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:03.326512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:03.330178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 602/1212] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:03.331810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37431c5-6f43-4bfe-b535-16c003407acc None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:03.447837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37431c5-6f43-4bfe-b535-16c003407acc None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:03.484884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3899112-3cea-45bf-811d-de998d6e9d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:03.485535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3899112-3cea-45bf-811d-de998d6e9d15 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:03.485819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3899112-3cea-45bf-811d-de998d6e9d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:03.486095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3899112-3cea-45bf-811d-de998d6e9d15 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:03.486887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3899112-3cea-45bf-811d-de998d6e9d15 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:03.487197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3899112-3cea-45bf-811d-de998d6e9d15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:03.488617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3899112-3cea-45bf-811d-de998d6e9d15 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:03.508667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 611/1213] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Aug 4 02:26:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:03.514522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0b064-7c29-41ad-8d7b-5da40e85dfe0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:03.636990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0b064-7c29-41ad-8d7b-5da40e85dfe0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:03.674885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592d4e-3603-43ba-8f68-9f0e1394a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:03.675696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592d4e-3603-43ba-8f68-9f0e1394a72e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:03.676076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592d4e-3603-43ba-8f68-9f0e1394a72e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:03.676544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592d4e-3603-43ba-8f68-9f0e1394a72e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:03.709762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:03.759242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70592d4e-3603-43ba-8f68-9f0e1394a72e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:03.761105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70592d4e-3603-43ba-8f68-9f0e1394a72e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:03.884626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 603/1214] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:26:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:26:03.890463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3899112-3cea-45bf-811d-de998d6e9d15 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:03.910408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:04.006439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3899112-3cea-45bf-811d-de998d6e9d15 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:04.048548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e478c-f445-401e-aee7-52c7b2f42f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:04.049214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e478c-f445-401e-aee7-52c7b2f42f04 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:04.049614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e478c-f445-401e-aee7-52c7b2f42f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:04.050450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e478c-f445-401e-aee7-52c7b2f42f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:04.061280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e478c-f445-401e-aee7-52c7b2f42f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:04.063432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e478c-f445-401e-aee7-52c7b2f42f04 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-9e1e478c-f445-401e-aee7-52c7b2f42f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:04.082147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:04.083528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:04.084408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:04.084408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:04.084408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:04.084408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:04.084408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 612/1215] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:26:04.089673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592d4e-3603-43ba-8f68-9f0e1394a72e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:04.163511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:04.210250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592d4e-3603-43ba-8f68-9f0e1394a72e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:04.252467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df06da8-e83a-4cec-9429-a8ca35f4a222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:04.253100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06da8-e83a-4cec-9429-a8ca35f4a222 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:04.253408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06da8-e83a-4cec-9429-a8ca35f4a222 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:04.254317 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06da8-e83a-4cec-9429-a8ca35f4a222 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:04.254430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df06da8-e83a-4cec-9429-a8ca35f4a222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:04.254650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df06da8-e83a-4cec-9429-a8ca35f4a222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:04.256067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df06da8-e83a-4cec-9429-a8ca35f4a222 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:04.269454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 604/1216] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:04.275692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e478c-f445-401e-aee7-52c7b2f42f04 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:04.372363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:04.416716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e478c-f445-401e-aee7-52c7b2f42f04 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:04.454870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01de7f7-68f9-490d-93a3-59c8078378a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:04.455533 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01de7f7-68f9-490d-93a3-59c8078378a0 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:04.455809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01de7f7-68f9-490d-93a3-59c8078378a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:04.456084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01de7f7-68f9-490d-93a3-59c8078378a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:04.462844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01de7f7-68f9-490d-93a3-59c8078378a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:04.464326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01de7f7-68f9-490d-93a3-59c8078378a0 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-b01de7f7-68f9-490d-93a3-59c8078378a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:26:04.476712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:04.477888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:04.478945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:26:04.478945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:26:04.478945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:26:04.478945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:26:04.478945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:26:04.478945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:26:04.478945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:04.478945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:04.478945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 613/1217] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:26:04.485169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df06da8-e83a-4cec-9429-a8ca35f4a222 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:04.604394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df06da8-e83a-4cec-9429-a8ca35f4a222 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:04.630076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:04.644479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76e91b-bde6-4cf5-8711-b591812f16d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:04.645158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76e91b-bde6-4cf5-8711-b591812f16d3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:04.645466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76e91b-bde6-4cf5-8711-b591812f16d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:04.645766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76e91b-bde6-4cf5-8711-b591812f16d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:04.646511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76e91b-bde6-4cf5-8711-b591812f16d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:04.646816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76e91b-bde6-4cf5-8711-b591812f16d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:04.648238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76e91b-bde6-4cf5-8711-b591812f16d3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:04.664065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 605/1218] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:04.673056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01de7f7-68f9-490d-93a3-59c8078378a0 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:04.775995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01de7f7-68f9-490d-93a3-59c8078378a0 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:04.804195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:04.810300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51569a26-9074-4c17-b1c9-5f8f78a2e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:04.811024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51569a26-9074-4c17-b1c9-5f8f78a2e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:04.811934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51569a26-9074-4c17-b1c9-5f8f78a2e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:04.812304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51569a26-9074-4c17-b1c9-5f8f78a2e8a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:04.813203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51569a26-9074-4c17-b1c9-5f8f78a2e8a1 None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=234cbff2a729458a8dad108baaba6c86) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:04.813632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51569a26-9074-4c17-b1c9-5f8f78a2e8a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:04.815152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51569a26-9074-4c17-b1c9-5f8f78a2e8a1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:04.820898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 614/1219] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:26:04 2022] GET /identity/v3/role_assignments?user.id=234cbff2a729458a8dad108baaba6c86&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:26:06.868491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4cf22-c236-46ad-a77e-e44078fd8e87 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:06.868993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4cf22-c236-46ad-a77e-e44078fd8e87 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:06.868993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4cf22-c236-46ad-a77e-e44078fd8e87 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:06.871774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 606/1220] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:26:06.875983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23764281-bb54-4cc5-a058-b0af4946e59f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:06.876466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23764281-bb54-4cc5-a058-b0af4946e59f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:06.876732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23764281-bb54-4cc5-a058-b0af4946e59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:06.895754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-23764281-bb54-4cc5-a058-b0af4946e59f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:06.896926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-23764281-bb54-4cc5-a058-b0af4946e59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:06.968184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 615/1221] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:26:06.993059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4cf22-c236-46ad-a77e-e44078fd8e87 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:07.107266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4cf22-c236-46ad-a77e-e44078fd8e87 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:07.150476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481145d-40c4-4866-8846-61f266bd806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:07.150981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481145d-40c4-4866-8846-61f266bd806c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:07.151258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481145d-40c4-4866-8846-61f266bd806c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:07.151532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481145d-40c4-4866-8846-61f266bd806c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:07.162260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481145d-40c4-4866-8846-61f266bd806c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c481145d-40c4-4866-8846-61f266bd806c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:26:07.167071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:07.168309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:07.169432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 607/1222] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:07.175583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23764281-bb54-4cc5-a058-b0af4946e59f None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:07.289237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23764281-bb54-4cc5-a058-b0af4946e59f None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:07.320924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:07.332239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a0b6-db39-4b29-9f9b-83b923f8ff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:07.332848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a0b6-db39-4b29-9f9b-83b923f8ff47 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:07.333122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a0b6-db39-4b29-9f9b-83b923f8ff47 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:07.333419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a0b6-db39-4b29-9f9b-83b923f8ff47 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:07.334120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4a0b6-db39-4b29-9f9b-83b923f8ff47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:07.334416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4a0b6-db39-4b29-9f9b-83b923f8ff47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:07.335762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4a0b6-db39-4b29-9f9b-83b923f8ff47 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:07.344543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 616/1223] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:26:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:07.354682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481145d-40c4-4866-8846-61f266bd806c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:07.404291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:07.462975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481145d-40c4-4866-8846-61f266bd806c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:07.497706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605555b-4af0-4936-b88f-01f83bf0575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:07.498323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605555b-4af0-4936-b88f-01f83bf0575f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:07.498608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605555b-4af0-4936-b88f-01f83bf0575f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:07.498884 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605555b-4af0-4936-b88f-01f83bf0575f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:07.509772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605555b-4af0-4936-b88f-01f83bf0575f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:07.511216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605555b-4af0-4936-b88f-01f83bf0575f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-5605555b-4af0-4936-b88f-01f83bf0575f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:07.525930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:07.527167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:07.528382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:07.528382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:07.528382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:07.528382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:07.528382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 608/1224] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:07.534662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a0b6-db39-4b29-9f9b-83b923f8ff47 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:07.640376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a0b6-db39-4b29-9f9b-83b923f8ff47 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:07.674281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50130a01-70c1-4d98-bad5-0d85060e79ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:07.674811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130a01-70c1-4d98-bad5-0d85060e79ae None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:07.675078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130a01-70c1-4d98-bad5-0d85060e79ae None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:07.675347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50130a01-70c1-4d98-bad5-0d85060e79ae None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:07.676031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50130a01-70c1-4d98-bad5-0d85060e79ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:07.676342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50130a01-70c1-4d98-bad5-0d85060e79ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:07.677712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50130a01-70c1-4d98-bad5-0d85060e79ae None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:07.690095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 617/1225] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:07.695803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605555b-4af0-4936-b88f-01f83bf0575f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:07.792628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:07.801194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605555b-4af0-4936-b88f-01f83bf0575f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:07.840743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16240c-843a-4883-8bdd-0efb78ecd4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:07.841402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16240c-843a-4883-8bdd-0efb78ecd4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:07.841684 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16240c-843a-4883-8bdd-0efb78ecd4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:07.841955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16240c-843a-4883-8bdd-0efb78ecd4e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:07.849713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16240c-843a-4883-8bdd-0efb78ecd4e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:07.851267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16240c-843a-4883-8bdd-0efb78ecd4e3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-6f16240c-843a-4883-8bdd-0efb78ecd4e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:26:07.863426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:07.864530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:07.865992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 609/1226] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:26:07.871608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50130a01-70c1-4d98-bad5-0d85060e79ae None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:07.919611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:07.980166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50130a01-70c1-4d98-bad5-0d85060e79ae None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:08.016848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b72d1-1d6a-403f-a093-9b808df3bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:08.017574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b72d1-1d6a-403f-a093-9b808df3bd87 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:08.017889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b72d1-1d6a-403f-a093-9b808df3bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:08.018219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b72d1-1d6a-403f-a093-9b808df3bd87 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:08.019179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b72d1-1d6a-403f-a093-9b808df3bd87 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:08.019484 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b72d1-1d6a-403f-a093-9b808df3bd87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:08.021114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b72d1-1d6a-403f-a093-9b808df3bd87 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:08.040515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 618/1227] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Aug 4 02:26:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:08.047459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16240c-843a-4883-8bdd-0efb78ecd4e3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:08.152409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16240c-843a-4883-8bdd-0efb78ecd4e3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:08.191905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c435-485d-4116-adc1-0a01c8423df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:08.192576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c435-485d-4116-adc1-0a01c8423df6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:08.192858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c435-485d-4116-adc1-0a01c8423df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:08.193132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c435-485d-4116-adc1-0a01c8423df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:08.204119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0c435-485d-4116-adc1-0a01c8423df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:08.205654 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0c435-485d-4116-adc1-0a01c8423df6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-19d0c435-485d-4116-adc1-0a01c8423df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:08.220554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:08.221581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:08.222559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:08.222559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:08.222559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:08.222559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:08.223434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 610/1228] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:08.229371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b72d1-1d6a-403f-a093-9b808df3bd87 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:08.350395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b72d1-1d6a-403f-a093-9b808df3bd87 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:08.352879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:08.391112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63142f-0bf2-47c3-a3f9-970349dbe17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:08.391770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63142f-0bf2-47c3-a3f9-970349dbe17d None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:08.392011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63142f-0bf2-47c3-a3f9-970349dbe17d None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:08.392286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63142f-0bf2-47c3-a3f9-970349dbe17d None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:08.392975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63142f-0bf2-47c3-a3f9-970349dbe17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:08.393283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63142f-0bf2-47c3-a3f9-970349dbe17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:08.394768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63142f-0bf2-47c3-a3f9-970349dbe17d None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:08.407393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 619/1229] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:08.413750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c435-485d-4116-adc1-0a01c8423df6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:08.425733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:08.528632 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c435-485d-4116-adc1-0a01c8423df6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:08.568896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f6f76-a627-45bd-8593-5cff62c80fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:08.569547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f6f76-a627-45bd-8593-5cff62c80fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:08.569824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f6f76-a627-45bd-8593-5cff62c80fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:08.570099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f6f76-a627-45bd-8593-5cff62c80fa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:08.577673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f6f76-a627-45bd-8593-5cff62c80fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:08.579077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f6f76-a627-45bd-8593-5cff62c80fa7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-2c5f6f76-a627-45bd-8593-5cff62c80fa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:26:08.594862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:08.596021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:08.597071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:26:08.597071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:26:08.597071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:26:08.597071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:26:08.597071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:26:08.597071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:26:08.597071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:08.597071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:08.597071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 611/1230] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:08.603269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63142f-0bf2-47c3-a3f9-970349dbe17d None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:08.724119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63142f-0bf2-47c3-a3f9-970349dbe17d None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:08.761801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45df97b-53ca-41e6-87ce-6e777ad72946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:08.762503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45df97b-53ca-41e6-87ce-6e777ad72946 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:08.762850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45df97b-53ca-41e6-87ce-6e777ad72946 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:08.763192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45df97b-53ca-41e6-87ce-6e777ad72946 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:08.764006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45df97b-53ca-41e6-87ce-6e777ad72946 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:08.764898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45df97b-53ca-41e6-87ce-6e777ad72946 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:08.766437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45df97b-53ca-41e6-87ce-6e777ad72946 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:08.787080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 620/1231] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:08.788681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f6f76-a627-45bd-8593-5cff62c80fa7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:08.866736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:08.907615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f6f76-a627-45bd-8593-5cff62c80fa7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:08.943815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb941f-8ca5-49b1-8e35-b0fcfff87701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:08.944480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb941f-8ca5-49b1-8e35-b0fcfff87701 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:08.944757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb941f-8ca5-49b1-8e35-b0fcfff87701 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:08.945054 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb941f-8ca5-49b1-8e35-b0fcfff87701 None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/234cbff2a729458a8dad108baaba6c86/roles/a60b7cc5e9e5429aafb8b22f5712c493` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:08.960264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb941f-8ca5-49b1-8e35-b0fcfff87701 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=234cbff2a729458a8dad108baaba6c86, role_id=a60b7cc5e9e5429aafb8b22f5712c493)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:08.961755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb941f-8ca5-49b1-8e35-b0fcfff87701 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:08.974355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 612/1232] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:26:08 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/234cbff2a729458a8dad108baaba6c86/roles/a60b7cc5e9e5429aafb8b22f5712c493 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:26:11.093672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae31d4-51f8-4810-853a-d9c232a5e624 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:11.094228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae31d4-51f8-4810-853a-d9c232a5e624 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:11.094228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae31d4-51f8-4810-853a-d9c232a5e624 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:11.095625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 621/1233] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:26:11.100779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3ab53-5533-4a17-a04c-a73c38357bfe None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:11.101197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3ab53-5533-4a17-a04c-a73c38357bfe None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:11.101359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3ab53-5533-4a17-a04c-a73c38357bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:11.120283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-dca3ab53-5533-4a17-a04c-a73c38357bfe None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:11.121517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dca3ab53-5533-4a17-a04c-a73c38357bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:11.191668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 613/1234] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:26:11.216073 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae31d4-51f8-4810-853a-d9c232a5e624 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:11.243112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:11.337683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae31d4-51f8-4810-853a-d9c232a5e624 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:11.378898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85e12a-5379-4d42-af9b-7d1cd506e7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:11.379685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85e12a-5379-4d42-af9b-7d1cd506e7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:11.380084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85e12a-5379-4d42-af9b-7d1cd506e7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:11.380401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85e12a-5379-4d42-af9b-7d1cd506e7f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:11.396180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85e12a-5379-4d42-af9b-7d1cd506e7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-0e85e12a-5379-4d42-af9b-7d1cd506e7f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:26:11.401367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:11.402502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:11.403520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 622/1235] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Aug 4 02:26:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:11.409182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3ab53-5533-4a17-a04c-a73c38357bfe None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:11.456515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:11.509628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3ab53-5533-4a17-a04c-a73c38357bfe None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:11.544472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9e3b1-f80f-4bcb-b140-7903102015a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:11.545086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9e3b1-f80f-4bcb-b140-7903102015a8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:11.545397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9e3b1-f80f-4bcb-b140-7903102015a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:11.545688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9e3b1-f80f-4bcb-b140-7903102015a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:11.546397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9e3b1-f80f-4bcb-b140-7903102015a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:11.546695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9e3b1-f80f-4bcb-b140-7903102015a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:11.548061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9e3b1-f80f-4bcb-b140-7903102015a8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:11.561002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 614/1236] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Aug 4 02:26:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:11.567196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85e12a-5379-4d42-af9b-7d1cd506e7f8 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:11.653777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:11.669945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85e12a-5379-4d42-af9b-7d1cd506e7f8 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:11.703617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35149e8-c2ef-45d4-a7d9-d5a90589a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:11.704258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35149e8-c2ef-45d4-a7d9-d5a90589a795 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:11.704537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35149e8-c2ef-45d4-a7d9-d5a90589a795 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:11.704809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35149e8-c2ef-45d4-a7d9-d5a90589a795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:11.716999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35149e8-c2ef-45d4-a7d9-d5a90589a795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:11.719057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35149e8-c2ef-45d4-a7d9-d5a90589a795 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-c35149e8-c2ef-45d4-a7d9-d5a90589a795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:11.735922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:11.737022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:11.738099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:11.738099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:11.738099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:11.738099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:11.738099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 623/1237] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:26:11.743708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9e3b1-f80f-4bcb-b140-7903102015a8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:11.854051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9e3b1-f80f-4bcb-b140-7903102015a8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:11.865754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:11.895898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcf9dd-fb97-40a6-ab23-cf49f6b4e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:11.896658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcf9dd-fb97-40a6-ab23-cf49f6b4e6ab None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:11.896995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcf9dd-fb97-40a6-ab23-cf49f6b4e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:11.897359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcf9dd-fb97-40a6-ab23-cf49f6b4e6ab None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:11.898246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcf9dd-fb97-40a6-ab23-cf49f6b4e6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:11.898546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcf9dd-fb97-40a6-ab23-cf49f6b4e6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:11.900770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcf9dd-fb97-40a6-ab23-cf49f6b4e6ab None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:11.914946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 615/1238] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:11.921151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35149e8-c2ef-45d4-a7d9-d5a90589a795 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:12.026070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35149e8-c2ef-45d4-a7d9-d5a90589a795 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:12.062985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30903e-3601-46a8-a5fd-d7c7a7d8894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:12.063758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30903e-3601-46a8-a5fd-d7c7a7d8894c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:12.064179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30903e-3601-46a8-a5fd-d7c7a7d8894c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:12.064474 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30903e-3601-46a8-a5fd-d7c7a7d8894c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:12.067171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:12.072668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30903e-3601-46a8-a5fd-d7c7a7d8894c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:12.074553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30903e-3601-46a8-a5fd-d7c7a7d8894c None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-2f30903e-3601-46a8-a5fd-d7c7a7d8894c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:26:12.086447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:12.087557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:12.089102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 624/1239] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:12.094074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcf9dd-fb97-40a6-ab23-cf49f6b4e6ab None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:12.205023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcf9dd-fb97-40a6-ab23-cf49f6b4e6ab None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:12.247478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144e976-af86-43d1-9172-5c27cb9dd98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:12.248169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144e976-af86-43d1-9172-5c27cb9dd98e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:12.248490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144e976-af86-43d1-9172-5c27cb9dd98e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:12.248932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144e976-af86-43d1-9172-5c27cb9dd98e None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:12.250087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144e976-af86-43d1-9172-5c27cb9dd98e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:12.250546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144e976-af86-43d1-9172-5c27cb9dd98e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:12.252081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144e976-af86-43d1-9172-5c27cb9dd98e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:12.275146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 616/1240] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Aug 4 02:26:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:26:12.281491 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30903e-3601-46a8-a5fd-d7c7a7d8894c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:12.392979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30903e-3601-46a8-a5fd-d7c7a7d8894c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:12.432066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1113c2-ad11-4370-b744-7854773bd9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:12.432843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1113c2-ad11-4370-b744-7854773bd9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:12.433124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1113c2-ad11-4370-b744-7854773bd9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:12.433427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1113c2-ad11-4370-b744-7854773bd9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:12.508497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:12.515128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1113c2-ad11-4370-b744-7854773bd9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:12.516668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1113c2-ad11-4370-b744-7854773bd9b2 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:12.634155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 625/1241] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:26:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:26:12.640815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144e976-af86-43d1-9172-5c27cb9dd98e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:12.673513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:12.757008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144e976-af86-43d1-9172-5c27cb9dd98e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:12.793187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827da7a9-1ff1-4b6f-ae87-1a828ff09720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:12.793799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827da7a9-1ff1-4b6f-ae87-1a828ff09720 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:12.794057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827da7a9-1ff1-4b6f-ae87-1a828ff09720 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:12.794327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827da7a9-1ff1-4b6f-ae87-1a828ff09720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:12.805422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827da7a9-1ff1-4b6f-ae87-1a828ff09720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:12.806853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827da7a9-1ff1-4b6f-ae87-1a828ff09720 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-827da7a9-1ff1-4b6f-ae87-1a828ff09720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:12.822616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:12.823714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:12.824629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:12.824629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:12.824629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:12.824629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:12.824629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 617/1242] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:26:12.829699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1113c2-ad11-4370-b744-7854773bd9b2 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:12.933643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:12.941201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1113c2-ad11-4370-b744-7854773bd9b2 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:12.984612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4d487-7fa2-401c-890c-355909d6bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:12.985233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4d487-7fa2-401c-890c-355909d6bda4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:12.985533 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4d487-7fa2-401c-890c-355909d6bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:12.985807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4d487-7fa2-401c-890c-355909d6bda4 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:12.986483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4d487-7fa2-401c-890c-355909d6bda4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:12.986781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4d487-7fa2-401c-890c-355909d6bda4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:12.988125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4d487-7fa2-401c-890c-355909d6bda4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:12.999244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 626/1243] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:13.004885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827da7a9-1ff1-4b6f-ae87-1a828ff09720 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:13.097601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:13.121149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827da7a9-1ff1-4b6f-ae87-1a828ff09720 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:13.156581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33761-344d-4179-b0e1-8538e8f029ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:13.157226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33761-344d-4179-b0e1-8538e8f029ab None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:13.157539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33761-344d-4179-b0e1-8538e8f029ab None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:13.157811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa33761-344d-4179-b0e1-8538e8f029ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:13.164688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa33761-344d-4179-b0e1-8538e8f029ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:13.166274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa33761-344d-4179-b0e1-8538e8f029ab None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4aa33761-344d-4179-b0e1-8538e8f029ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:26:13.179050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:13.180228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:13.181550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:26:13.181550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:26:13.181550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:26:13.181550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:26:13.181550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:26:13.181550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:26:13.181550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:13.181550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:13.181550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 618/1244] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:13.186362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4d487-7fa2-401c-890c-355909d6bda4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:13.300410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4d487-7fa2-401c-890c-355909d6bda4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:13.339641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dabf0d-a1e6-4be5-a214-83d35fc53571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:13.340644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dabf0d-a1e6-4be5-a214-83d35fc53571 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:13.340976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dabf0d-a1e6-4be5-a214-83d35fc53571 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:13.341414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dabf0d-a1e6-4be5-a214-83d35fc53571 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:13.342466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dabf0d-a1e6-4be5-a214-83d35fc53571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:13.343040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dabf0d-a1e6-4be5-a214-83d35fc53571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:13.344719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dabf0d-a1e6-4be5-a214-83d35fc53571 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:13.361660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 627/1245] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:26:13.367936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33761-344d-4179-b0e1-8538e8f029ab None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:13.485635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa33761-344d-4179-b0e1-8538e8f029ab None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:13.520813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb1c38-4e31-485c-b05a-0a4b025e4939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:13.521573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1c38-4e31-485c-b05a-0a4b025e4939 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:13.521863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1c38-4e31-485c-b05a-0a4b025e4939 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:13.522126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1c38-4e31-485c-b05a-0a4b025e4939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:13.523039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1c38-4e31-485c-b05a-0a4b025e4939 None admin] RBAC: Adding query filter params (role.id=a60b7cc5e9e5429aafb8b22f5712c493, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=234cbff2a729458a8dad108baaba6c86) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:13.523342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1c38-4e31-485c-b05a-0a4b025e4939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:13.525134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1c38-4e31-485c-b05a-0a4b025e4939 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:13.532185 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 619/1246] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:26:13 2022] GET /identity/v3/role_assignments?user.id=234cbff2a729458a8dad108baaba6c86&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=a60b7cc5e9e5429aafb8b22f5712c493 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:15.792802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22e54-0899-49c9-a8e8-c04a5e0e61a7 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:15.793564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22e54-0899-49c9-a8e8-c04a5e0e61a7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:15.793564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22e54-0899-49c9-a8e8-c04a5e0e61a7 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:15.794757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 628/1247] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:26:15.800809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaf356-2578-4433-b210-51220a799ca3 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:15.801245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaf356-2578-4433-b210-51220a799ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:15.801356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaf356-2578-4433-b210-51220a799ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:15.808005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:15.822023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-10aaf356-2578-4433-b210-51220a799ca3 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:15.823276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-10aaf356-2578-4433-b210-51220a799ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:15.900708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 620/1248] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:26:15.925571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd22e54-0899-49c9-a8e8-c04a5e0e61a7 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:15.944918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:16.038538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd22e54-0899-49c9-a8e8-c04a5e0e61a7 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:16.076350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee3494-f995-4e26-bae9-b19c05300ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:16.077678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3494-f995-4e26-bae9-b19c05300ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:16.078029 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3494-f995-4e26-bae9-b19c05300ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:16.078306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3494-f995-4e26-bae9-b19c05300ed5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:16.089731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee3494-f995-4e26-bae9-b19c05300ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-10ee3494-f995-4e26-bae9-b19c05300ed5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:26:16.097541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:16.098983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:16.100027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 629/1249] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:26:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:16.105627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaf356-2578-4433-b210-51220a799ca3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:16.222335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaf356-2578-4433-b210-51220a799ca3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:16.255098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:16.261597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1079d-1406-47fd-b2ca-b025abfd9d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:16.262391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1079d-1406-47fd-b2ca-b025abfd9d7e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:16.262709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1079d-1406-47fd-b2ca-b025abfd9d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:16.263083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1079d-1406-47fd-b2ca-b025abfd9d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:16.263972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1079d-1406-47fd-b2ca-b025abfd9d7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:16.264858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1079d-1406-47fd-b2ca-b025abfd9d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:16.267035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1079d-1406-47fd-b2ca-b025abfd9d7e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:16.278616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 621/1250] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:26:16.287974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee3494-f995-4e26-bae9-b19c05300ed5 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:16.381758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:16.406794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee3494-f995-4e26-bae9-b19c05300ed5 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:16.442192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec659a5-f6fc-4cd2-adcf-d454e2a02cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:16.442822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec659a5-f6fc-4cd2-adcf-d454e2a02cce None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:16.443095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec659a5-f6fc-4cd2-adcf-d454e2a02cce None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:16.443371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec659a5-f6fc-4cd2-adcf-d454e2a02cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:16.453345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec659a5-f6fc-4cd2-adcf-d454e2a02cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:16.454795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec659a5-f6fc-4cd2-adcf-d454e2a02cce None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-eec659a5-f6fc-4cd2-adcf-d454e2a02cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:16.470888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:16.472277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:16.473383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:16.473383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:16.473383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:16.473383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:16.473383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 630/1251] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:16.477915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1079d-1406-47fd-b2ca-b025abfd9d7e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:16.596925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1079d-1406-47fd-b2ca-b025abfd9d7e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:16.636672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643a350-1d90-48bc-85df-af5b14f28831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:16.637284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643a350-1d90-48bc-85df-af5b14f28831 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:16.637721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643a350-1d90-48bc-85df-af5b14f28831 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:16.638078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643a350-1d90-48bc-85df-af5b14f28831 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:16.639073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643a350-1d90-48bc-85df-af5b14f28831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:16.639476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643a350-1d90-48bc-85df-af5b14f28831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:16.641251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643a350-1d90-48bc-85df-af5b14f28831 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:16.653753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 622/1252] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:16.660445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec659a5-f6fc-4cd2-adcf-d454e2a02cce None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:16.790450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec659a5-f6fc-4cd2-adcf-d454e2a02cce None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:16.818714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:16.827818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf9a0b-c47e-43f2-9dbf-751ec688b46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:16.828465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf9a0b-c47e-43f2-9dbf-751ec688b46a None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:16.828822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf9a0b-c47e-43f2-9dbf-751ec688b46a None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:16.829007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf9a0b-c47e-43f2-9dbf-751ec688b46a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:16.837466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf9a0b-c47e-43f2-9dbf-751ec688b46a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:16.838963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf9a0b-c47e-43f2-9dbf-751ec688b46a None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-ccbf9a0b-c47e-43f2-9dbf-751ec688b46a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:26:16.850843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:16.852204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:16.853525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 631/1253] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:16.858980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643a350-1d90-48bc-85df-af5b14f28831 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:16.921727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:16.975053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643a350-1d90-48bc-85df-af5b14f28831 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:17.013948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f027e-a6ae-4600-8695-553262332690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:17.016553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f027e-a6ae-4600-8695-553262332690 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:17.016927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f027e-a6ae-4600-8695-553262332690 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:17.017157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f027e-a6ae-4600-8695-553262332690 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:17.018064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f027e-a6ae-4600-8695-553262332690 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:17.018355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f027e-a6ae-4600-8695-553262332690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:17.019863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f027e-a6ae-4600-8695-553262332690 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:17.039948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 623/1254] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Aug 4 02:26:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:17.045751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf9a0b-c47e-43f2-9dbf-751ec688b46a None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:17.154212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf9a0b-c47e-43f2-9dbf-751ec688b46a None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:17.196058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1f282-8055-4d89-80a7-6be59dbbdfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:17.196690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1f282-8055-4d89-80a7-6be59dbbdfbe None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:17.196968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1f282-8055-4d89-80a7-6be59dbbdfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:17.197244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1f282-8055-4d89-80a7-6be59dbbdfbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:17.260423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:17.275921 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1f282-8055-4d89-80a7-6be59dbbdfbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:17.277312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1f282-8055-4d89-80a7-6be59dbbdfbe None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:17.386770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 632/1255] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:26:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:26:17.392673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f027e-a6ae-4600-8695-553262332690 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:17.505128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f027e-a6ae-4600-8695-553262332690 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:17.518913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:17.541111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d97c17-170a-4693-801d-48a76a2ed3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:17.541861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d97c17-170a-4693-801d-48a76a2ed3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:17.542139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d97c17-170a-4693-801d-48a76a2ed3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:17.542409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d97c17-170a-4693-801d-48a76a2ed3d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:17.555900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d97c17-170a-4693-801d-48a76a2ed3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:17.557856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d97c17-170a-4693-801d-48a76a2ed3d9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f2d97c17-170a-4693-801d-48a76a2ed3d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:17.575699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:17.576892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:17.577837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:17.577837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:17.577837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:17.577837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:17.577837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 624/1256] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:17.583154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1f282-8055-4d89-80a7-6be59dbbdfbe None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:17.687579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:17.700687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1f282-8055-4d89-80a7-6be59dbbdfbe None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:17.737747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c941e-2d04-46df-9951-8db7bb147241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:17.738363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c941e-2d04-46df-9951-8db7bb147241 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:17.738687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c941e-2d04-46df-9951-8db7bb147241 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:17.739088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c941e-2d04-46df-9951-8db7bb147241 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:17.739729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c941e-2d04-46df-9951-8db7bb147241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:17.740075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c941e-2d04-46df-9951-8db7bb147241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:17.741575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c941e-2d04-46df-9951-8db7bb147241 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:17.754750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 633/1257] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:17.760487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d97c17-170a-4693-801d-48a76a2ed3d9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:17.872576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d97c17-170a-4693-801d-48a76a2ed3d9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:17.910046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12177206-5677-4e12-8e9a-6b884ea704b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:17.910823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12177206-5677-4e12-8e9a-6b884ea704b1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:17.911240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12177206-5677-4e12-8e9a-6b884ea704b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:17.911526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12177206-5677-4e12-8e9a-6b884ea704b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:17.918536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12177206-5677-4e12-8e9a-6b884ea704b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:17.919989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12177206-5677-4e12-8e9a-6b884ea704b1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-12177206-5677-4e12-8e9a-6b884ea704b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:26:17.932338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:17.933453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:17.934471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:26:17.934471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:26:17.934471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:26:17.934471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:26:17.934471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:26:17.934471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:26:17.934471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:17.934471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:17.934471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 625/1258] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:17.939909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c941e-2d04-46df-9951-8db7bb147241 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:18.046443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c941e-2d04-46df-9951-8db7bb147241 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:18.087343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec58ae0-130a-4f15-9f15-1b2db8d36463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:18.087954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec58ae0-130a-4f15-9f15-1b2db8d36463 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:18.088228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec58ae0-130a-4f15-9f15-1b2db8d36463 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:18.088496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec58ae0-130a-4f15-9f15-1b2db8d36463 None admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:18.089234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec58ae0-130a-4f15-9f15-1b2db8d36463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:18.089561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec58ae0-130a-4f15-9f15-1b2db8d36463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:18.090970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec58ae0-130a-4f15-9f15-1b2db8d36463 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:18.103985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 634/1259] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:26:18.110786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12177206-5677-4e12-8e9a-6b884ea704b1 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:18.140874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:18.224818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12177206-5677-4e12-8e9a-6b884ea704b1 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:18.260737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251b2de-1b89-40e4-8b22-8c0607f157cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:18.261364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251b2de-1b89-40e4-8b22-8c0607f157cd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:18.261646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251b2de-1b89-40e4-8b22-8c0607f157cd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:18.261921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251b2de-1b89-40e4-8b22-8c0607f157cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:18.262700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251b2de-1b89-40e4-8b22-8c0607f157cd None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=234cbff2a729458a8dad108baaba6c86) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:18.263007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251b2de-1b89-40e4-8b22-8c0607f157cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:18.264491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251b2de-1b89-40e4-8b22-8c0607f157cd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:18.271112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 626/1260] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:26:18 2022] GET /identity/v3/role_assignments?user.id=234cbff2a729458a8dad108baaba6c86&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=999cac3070e64b82b981258349005963 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:20.294206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e36f6-ac39-477a-bd3b-7bc29ce61421 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:20.294866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e36f6-ac39-477a-bd3b-7bc29ce61421 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:20.294866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e36f6-ac39-477a-bd3b-7bc29ce61421 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:20.296142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 635/1261] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:26:20.302391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77a73-8136-4b74-bc85-bb768c5e2298 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:20.302977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77a73-8136-4b74-bc85-bb768c5e2298 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:20.302977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77a73-8136-4b74-bc85-bb768c5e2298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:20.322780 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-def77a73-8136-4b74-bc85-bb768c5e2298 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:20.323981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-def77a73-8136-4b74-bc85-bb768c5e2298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:20.388133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 627/1262] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:26:20.410397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e36f6-ac39-477a-bd3b-7bc29ce61421 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:20.421090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:20.508232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e36f6-ac39-477a-bd3b-7bc29ce61421 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:20.541011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce96b2c-becf-4d57-9c6f-50f14621452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:20.541649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce96b2c-becf-4d57-9c6f-50f14621452c None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:20.541923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce96b2c-becf-4d57-9c6f-50f14621452c None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:20.542187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce96b2c-becf-4d57-9c6f-50f14621452c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:20.551832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce96b2c-becf-4d57-9c6f-50f14621452c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-4ce96b2c-becf-4d57-9c6f-50f14621452c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:26:20.556581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:20.557732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:20.558934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 636/1263] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 02:26:20.564200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77a73-8136-4b74-bc85-bb768c5e2298 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:20.582805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:20.660594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77a73-8136-4b74-bc85-bb768c5e2298 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:20.693319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2c006-6950-48a2-9a36-74856c390878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:20.694058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2c006-6950-48a2-9a36-74856c390878 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:20.694340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2c006-6950-48a2-9a36-74856c390878 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:20.694613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2c006-6950-48a2-9a36-74856c390878 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:20.695310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2c006-6950-48a2-9a36-74856c390878 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:20.695606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2c006-6950-48a2-9a36-74856c390878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:20.696956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2c006-6950-48a2-9a36-74856c390878 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:20.704750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 628/1264] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:26:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:20.710636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce96b2c-becf-4d57-9c6f-50f14621452c None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:20.781592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:20.813971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce96b2c-becf-4d57-9c6f-50f14621452c None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:20.845584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3c0e-dc24-45a3-a312-822c8e357258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:20.846193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3c0e-dc24-45a3-a312-822c8e357258 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:20.846468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3c0e-dc24-45a3-a312-822c8e357258 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:20.846734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3c0e-dc24-45a3-a312-822c8e357258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:20.856294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d3c0e-dc24-45a3-a312-822c8e357258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:20.858255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d3c0e-dc24-45a3-a312-822c8e357258 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-821d3c0e-dc24-45a3-a312-822c8e357258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:20.872217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:20.873217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:20.874718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:20.874718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:20.874718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:20.874718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:20.874718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 637/1265] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:20.879541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2c006-6950-48a2-9a36-74856c390878 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:20.958666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:20.977933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2c006-6950-48a2-9a36-74856c390878 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:21.009168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352f926-3b4a-4d6e-8e95-5ec8ca83f801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:21.009788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352f926-3b4a-4d6e-8e95-5ec8ca83f801 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:21.010063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352f926-3b4a-4d6e-8e95-5ec8ca83f801 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:21.010331 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352f926-3b4a-4d6e-8e95-5ec8ca83f801 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:21.011026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352f926-3b4a-4d6e-8e95-5ec8ca83f801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:21.011321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352f926-3b4a-4d6e-8e95-5ec8ca83f801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:21.012669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352f926-3b4a-4d6e-8e95-5ec8ca83f801 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:21.024667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 629/1266] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:21.030904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3c0e-dc24-45a3-a312-822c8e357258 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:21.127916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3c0e-dc24-45a3-a312-822c8e357258 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:21.147161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:21.161075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0106c04-5e68-4666-a462-6af99cd5acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:21.161725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0106c04-5e68-4666-a462-6af99cd5acdd None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:21.162008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0106c04-5e68-4666-a462-6af99cd5acdd None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:21.162279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0106c04-5e68-4666-a462-6af99cd5acdd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:21.169449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0106c04-5e68-4666-a462-6af99cd5acdd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:21.170863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0106c04-5e68-4666-a462-6af99cd5acdd None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-d0106c04-5e68-4666-a462-6af99cd5acdd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:26:21.181721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:21.182812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:21.183986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 638/1267] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:21.188888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352f926-3b4a-4d6e-8e95-5ec8ca83f801 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:21.287891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352f926-3b4a-4d6e-8e95-5ec8ca83f801 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:21.324927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cce57-b9c1-48ba-b5d4-25357212c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:21.325809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cce57-b9c1-48ba-b5d4-25357212c886 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:21.325929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cce57-b9c1-48ba-b5d4-25357212c886 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:21.326119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cce57-b9c1-48ba-b5d4-25357212c886 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:21.327045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cce57-b9c1-48ba-b5d4-25357212c886 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:21.327332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cce57-b9c1-48ba-b5d4-25357212c886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:21.328962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cce57-b9c1-48ba-b5d4-25357212c886 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:21.338486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:21.348060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 630/1268] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Aug 4 02:26:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:21.353800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0106c04-5e68-4666-a462-6af99cd5acdd None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:21.451046 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0106c04-5e68-4666-a462-6af99cd5acdd None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:21.483836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f03e2-d83a-4e6e-8d5f-a54454d04350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:21.484452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f03e2-d83a-4e6e-8d5f-a54454d04350 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:21.484727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f03e2-d83a-4e6e-8d5f-a54454d04350 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:21.484996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f03e2-d83a-4e6e-8d5f-a54454d04350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:21.495820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f03e2-d83a-4e6e-8d5f-a54454d04350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:21.497230 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f03e2-d83a-4e6e-8d5f-a54454d04350 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-ce5f03e2-d83a-4e6e-8d5f-a54454d04350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:21.510774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:21.511851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:21.512968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:21.512968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:21.512968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:21.512968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:21.512968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 639/1269] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:21.517942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cce57-b9c1-48ba-b5d4-25357212c886 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:21.617551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cce57-b9c1-48ba-b5d4-25357212c886 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:21.650578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a07cb-fbf8-444b-ac6a-3dcfa355eb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:21.651177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a07cb-fbf8-444b-ac6a-3dcfa355eb2d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:21.651457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a07cb-fbf8-444b-ac6a-3dcfa355eb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:21.651732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a07cb-fbf8-444b-ac6a-3dcfa355eb2d None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:21.652409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a07cb-fbf8-444b-ac6a-3dcfa355eb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:21.652711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a07cb-fbf8-444b-ac6a-3dcfa355eb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:21.654094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a07cb-fbf8-444b-ac6a-3dcfa355eb2d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:21.665647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 631/1270] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:21.671161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f03e2-d83a-4e6e-8d5f-a54454d04350 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:21.701291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:21.767287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f03e2-d83a-4e6e-8d5f-a54454d04350 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:21.799226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fabca3-07ff-4774-8d96-bc9c120bf9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:21.799840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fabca3-07ff-4774-8d96-bc9c120bf9ef None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:21.800113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fabca3-07ff-4774-8d96-bc9c120bf9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:21.800378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fabca3-07ff-4774-8d96-bc9c120bf9ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:21.806722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fabca3-07ff-4774-8d96-bc9c120bf9ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:21.808142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fabca3-07ff-4774-8d96-bc9c120bf9ef None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-b8fabca3-07ff-4774-8d96-bc9c120bf9ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:26:21.819538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:21.820566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:21.821729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:26:21.821729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:26:21.821729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:26:21.821729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:26:21.821729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:26:21.821729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:26:21.821729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:21.821729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:21.825142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 640/1271] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:21.826292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a07cb-fbf8-444b-ac6a-3dcfa355eb2d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:21.883430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:21.923904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a07cb-fbf8-444b-ac6a-3dcfa355eb2d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:21.958842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaef67-8e70-4e12-8d23-c5325f56c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:21.959389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaef67-8e70-4e12-8d23-c5325f56c84c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:21.959670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaef67-8e70-4e12-8d23-c5325f56c84c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:21.959942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaef67-8e70-4e12-8d23-c5325f56c84c None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:21.960677 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaef67-8e70-4e12-8d23-c5325f56c84c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:21.960984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaef67-8e70-4e12-8d23-c5325f56c84c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:21.962427 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaef67-8e70-4e12-8d23-c5325f56c84c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:21.974060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 632/1272] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:21.979943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fabca3-07ff-4774-8d96-bc9c120bf9ef None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:22.067537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:22.076067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fabca3-07ff-4774-8d96-bc9c120bf9ef None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:22.107923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bf325-a9df-4e54-a2a2-44bcd19d5b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:22.108560 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf325-a9df-4e54-a2a2-44bcd19d5b09 None admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:22.108834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf325-a9df-4e54-a2a2-44bcd19d5b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:22.109102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bf325-a9df-4e54-a2a2-44bcd19d5b09 None admin] PATH_INFO: `/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/234cbff2a729458a8dad108baaba6c86/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:22.111005 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bf325-a9df-4e54-a2a2-44bcd19d5b09 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user_id=234cbff2a729458a8dad108baaba6c86, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:22.112398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bf325-a9df-4e54-a2a2-44bcd19d5b09 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:22.124942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 641/1273] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Aug 4 02:26:21 2022] PUT /identity/v3/projects/0bf5e1d00db34b0eacd1a5d39c76fbbc/users/234cbff2a729458a8dad108baaba6c86/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:26:24.092803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43068669-7ba1-4337-a226-53ff3921b6ff None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:24.093354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43068669-7ba1-4337-a226-53ff3921b6ff None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:24.093354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43068669-7ba1-4337-a226-53ff3921b6ff None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:24.094731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 633/1274] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:26:24.099838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684e349-db01-4b59-8586-8a41dd815e72 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:24.100214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684e349-db01-4b59-8586-8a41dd815e72 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:24.100374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684e349-db01-4b59-8586-8a41dd815e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:24.118548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9684e349-db01-4b59-8586-8a41dd815e72 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:24.119711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9684e349-db01-4b59-8586-8a41dd815e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:24.183108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 642/1275] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:26:24.205037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43068669-7ba1-4337-a226-53ff3921b6ff None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:24.308559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43068669-7ba1-4337-a226-53ff3921b6ff None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:24.328146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:24.345395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f64e9-115c-425d-87c4-da426d3d0879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:24.345976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f64e9-115c-425d-87c4-da426d3d0879 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:24.346259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f64e9-115c-425d-87c4-da426d3d0879 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:24.346535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f64e9-115c-425d-87c4-da426d3d0879 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:24.356283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f64e9-115c-425d-87c4-da426d3d0879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-cd7f64e9-115c-425d-87c4-da426d3d0879 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 02:26:24.361823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:24.362899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:24.363811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 634/1276] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Aug 4 02:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:24.368975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684e349-db01-4b59-8586-8a41dd815e72 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:24.446601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:24.465078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684e349-db01-4b59-8586-8a41dd815e72 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:24.497636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df354b2-8fa6-41f5-b44b-5fbf1a1588b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:24.498258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df354b2-8fa6-41f5-b44b-5fbf1a1588b4 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:24.498536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df354b2-8fa6-41f5-b44b-5fbf1a1588b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:24.498811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df354b2-8fa6-41f5-b44b-5fbf1a1588b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:24.499508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df354b2-8fa6-41f5-b44b-5fbf1a1588b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:24.499807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df354b2-8fa6-41f5-b44b-5fbf1a1588b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:24.501148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df354b2-8fa6-41f5-b44b-5fbf1a1588b4 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:24.508925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 643/1277] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Aug 4 02:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:24.515028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f64e9-115c-425d-87c4-da426d3d0879 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:24.614031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f64e9-115c-425d-87c4-da426d3d0879 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:24.646175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965af66-0827-43d6-9841-3b1b58523630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:24.646788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965af66-0827-43d6-9841-3b1b58523630 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:24.647063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965af66-0827-43d6-9841-3b1b58523630 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:24.647336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965af66-0827-43d6-9841-3b1b58523630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:24.657702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965af66-0827-43d6-9841-3b1b58523630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:24.659128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965af66-0827-43d6-9841-3b1b58523630 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c965af66-0827-43d6-9841-3b1b58523630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:24.673775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:24.674805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:24.675907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:24.675907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:24.675907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:24.675907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:24.675907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 635/1278] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:24.680508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df354b2-8fa6-41f5-b44b-5fbf1a1588b4 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:24.776873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df354b2-8fa6-41f5-b44b-5fbf1a1588b4 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:24.809300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98166d-4d94-459b-be19-a7a924554201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:24.809928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98166d-4d94-459b-be19-a7a924554201 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:24.810208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98166d-4d94-459b-be19-a7a924554201 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:24.810480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98166d-4d94-459b-be19-a7a924554201 None admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:24.811650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98166d-4d94-459b-be19-a7a924554201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:24.811947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98166d-4d94-459b-be19-a7a924554201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:24.813294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98166d-4d94-459b-be19-a7a924554201 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:24.825261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 644/1279] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:24.831597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965af66-0827-43d6-9841-3b1b58523630 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:24.862361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:24.930012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965af66-0827-43d6-9841-3b1b58523630 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:24.962282 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaf47d-90f5-48ad-a43c-f32bf8976ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:24.962894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaf47d-90f5-48ad-a43c-f32bf8976ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:24.963172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaf47d-90f5-48ad-a43c-f32bf8976ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:24.963444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaf47d-90f5-48ad-a43c-f32bf8976ee5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:24.971097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaf47d-90f5-48ad-a43c-f32bf8976ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:24.972529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaf47d-90f5-48ad-a43c-f32bf8976ee5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-18aaf47d-90f5-48ad-a43c-f32bf8976ee5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 02:26:24.983918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:24.985106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:24.986228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 636/1280] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:24.990835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98166d-4d94-459b-be19-a7a924554201 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:24.994526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:25.086160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98166d-4d94-459b-be19-a7a924554201 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:25.119175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049e56-5b5f-4650-8607-b88c83c6e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:25.119768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049e56-5b5f-4650-8607-b88c83c6e897 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:25.120043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049e56-5b5f-4650-8607-b88c83c6e897 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:25.120313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049e56-5b5f-4650-8607-b88c83c6e897 None admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:25.121089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2049e56-5b5f-4650-8607-b88c83c6e897 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:25.121416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2049e56-5b5f-4650-8607-b88c83c6e897 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:25.122813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2049e56-5b5f-4650-8607-b88c83c6e897 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:25.139114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 645/1281] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Aug 4 02:26:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:25.144807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaf47d-90f5-48ad-a43c-f32bf8976ee5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:25.234269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:25.244558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaf47d-90f5-48ad-a43c-f32bf8976ee5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:25.280211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5a14-f961-4997-bc51-0fa54be88317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:25.280832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5a14-f961-4997-bc51-0fa54be88317 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:25.281184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5a14-f961-4997-bc51-0fa54be88317 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:25.281497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5a14-f961-4997-bc51-0fa54be88317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:25.347942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5a14-f961-4997-bc51-0fa54be88317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:25.349390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5a14-f961-4997-bc51-0fa54be88317 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:25.433783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:25.444543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 637/1282] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Aug 4 02:26:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 02:26:25.450294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049e56-5b5f-4650-8607-b88c83c6e897 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:25.509271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:25.547719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049e56-5b5f-4650-8607-b88c83c6e897 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:25.581422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a14fa-819a-4967-be24-84638e908e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:25.582048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a14fa-819a-4967-be24-84638e908e93 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:25.582325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a14fa-819a-4967-be24-84638e908e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:25.582594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a14fa-819a-4967-be24-84638e908e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:25.592828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a14fa-819a-4967-be24-84638e908e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:25.594272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a14fa-819a-4967-be24-84638e908e93 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-876a14fa-819a-4967-be24-84638e908e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 02:26:25.608906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:25.609986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:25.611098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 02:26:25.611098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 02:26:25.611098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 02:26:25.611098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:25.613475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 646/1283] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:25.615577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5a14-f961-4997-bc51-0fa54be88317 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:25.709083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5a14-f961-4997-bc51-0fa54be88317 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:25.741653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efc8dd-aa10-47b1-ad6e-fe76db9d4ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:25.742240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc8dd-aa10-47b1-ad6e-fe76db9d4ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:25.742514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc8dd-aa10-47b1-ad6e-fe76db9d4ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:25.742781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc8dd-aa10-47b1-ad6e-fe76db9d4ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:25.743449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efc8dd-aa10-47b1-ad6e-fe76db9d4ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:25.743743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efc8dd-aa10-47b1-ad6e-fe76db9d4ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:25.745091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efc8dd-aa10-47b1-ad6e-fe76db9d4ee5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:25.756342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 638/1284] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Aug 4 02:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:25.761786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a14fa-819a-4967-be24-84638e908e93 None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:25.858568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a14fa-819a-4967-be24-84638e908e93 None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:25.871422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:25.890680 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32085e-3f23-4d61-8d3c-00a102bd1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:25.891293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32085e-3f23-4d61-8d3c-00a102bd1eaf None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:25.891572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32085e-3f23-4d61-8d3c-00a102bd1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:25.891845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32085e-3f23-4d61-8d3c-00a102bd1eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:25.898210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32085e-3f23-4d61-8d3c-00a102bd1eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:25.899870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32085e-3f23-4d61-8d3c-00a102bd1eaf None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application [None req-9d32085e-3f23-4d61-8d3c-00a102bd1eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 02:26:25.911350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:25.912371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:25.913315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 02:26:25.913315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 02:26:25.913315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 02:26:25.913315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 02:26:25.913315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 02:26:25.913315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 02:26:25.913315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 02:26:25.913315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: ERROR keystone.server.flask.application Aug 04 02:26:25.913315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 647/1285] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Aug 4 02:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:25.918141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efc8dd-aa10-47b1-ad6e-fe76db9d4ee5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:25.968962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:26.019002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efc8dd-aa10-47b1-ad6e-fe76db9d4ee5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:26.051071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b173e-82e8-4869-a24f-5a76c31d45a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:26.051662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b173e-82e8-4869-a24f-5a76c31d45a4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:26.051938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b173e-82e8-4869-a24f-5a76c31d45a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:26.052206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b173e-82e8-4869-a24f-5a76c31d45a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:26.052938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b173e-82e8-4869-a24f-5a76c31d45a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:26.053239 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b173e-82e8-4869-a24f-5a76c31d45a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:26.054682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b173e-82e8-4869-a24f-5a76c31d45a4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:26.066836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 639/1286] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Aug 4 02:26:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:26.072716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32085e-3f23-4d61-8d3c-00a102bd1eaf None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:26.168455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32085e-3f23-4d61-8d3c-00a102bd1eaf None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:26.200936 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dccde8-35b0-45f6-9e6c-737d359ea7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:26.202074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dccde8-35b0-45f6-9e6c-737d359ea7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:26.202350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dccde8-35b0-45f6-9e6c-737d359ea7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:26.202617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dccde8-35b0-45f6-9e6c-737d359ea7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:26.203382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dccde8-35b0-45f6-9e6c-737d359ea7a9 None admin] RBAC: Adding query filter params (role.id=999cac3070e64b82b981258349005963, scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc, user.id=234cbff2a729458a8dad108baaba6c86) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:26.203685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dccde8-35b0-45f6-9e6c-737d359ea7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:26.205083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dccde8-35b0-45f6-9e6c-737d359ea7a9 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:26.210690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 648/1287] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Aug 4 02:26:26 2022] GET /identity/v3/role_assignments?user.id=234cbff2a729458a8dad108baaba6c86&scope.project.id=0bf5e1d00db34b0eacd1a5d39c76fbbc&role.id=999cac3070e64b82b981258349005963 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:26:28.196102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda5b3-ae56-4e16-8fc1-f0524ef3c25d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:28.196629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda5b3-ae56-4e16-8fc1-f0524ef3c25d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:28.196629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda5b3-ae56-4e16-8fc1-f0524ef3c25d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:28.198037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 640/1288] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:26:28.202963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8cb91-c5be-4098-9082-c567f22fa0fa None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:28.203396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8cb91-c5be-4098-9082-c567f22fa0fa None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:28.203503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8cb91-c5be-4098-9082-c567f22fa0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:28.221999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-36f8cb91-c5be-4098-9082-c567f22fa0fa None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:28.223174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-36f8cb91-c5be-4098-9082-c567f22fa0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:28.252503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:28.289911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 649/1289] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:26:28.312440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdda5b3-ae56-4e16-8fc1-f0524ef3c25d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:28.411905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdda5b3-ae56-4e16-8fc1-f0524ef3c25d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:28.422674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:28.445790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9bdcd-4857-4224-a51f-e454f762945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:28.446468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9bdcd-4857-4224-a51f-e454f762945f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:28.446693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9bdcd-4857-4224-a51f-e454f762945f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:28.446966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9bdcd-4857-4224-a51f-e454f762945f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:28.447576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9bdcd-4857-4224-a51f-e454f762945f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:28.448925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9bdcd-4857-4224-a51f-e454f762945f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-93a9bdcd-4857-4224-a51f-e454f762945f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:28.457576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:28.458792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:28.460070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 641/1290] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:26:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:28.464721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8cb91-c5be-4098-9082-c567f22fa0fa None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:28.558708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8cb91-c5be-4098-9082-c567f22fa0fa None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:28.592356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccf7ce-c930-46fb-96e1-3a29b4809975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:28.592970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf7ce-c930-46fb-96e1-3a29b4809975 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:28.593247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf7ce-c930-46fb-96e1-3a29b4809975 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:28.593548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccf7ce-c930-46fb-96e1-3a29b4809975 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:28.594215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccf7ce-c930-46fb-96e1-3a29b4809975 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:28.594515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccf7ce-c930-46fb-96e1-3a29b4809975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:28.595857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccf7ce-c930-46fb-96e1-3a29b4809975 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:28.600556 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 650/1291] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Aug 4 02:26:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:28.606182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9bdcd-4857-4224-a51f-e454f762945f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:28.702009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9bdcd-4857-4224-a51f-e454f762945f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:28.734530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b5709-0f62-4b18-9cae-777ee1a0f4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:28.735117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5709-0f62-4b18-9cae-777ee1a0f4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:28.735394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5709-0f62-4b18-9cae-777ee1a0f4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:28.735666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5709-0f62-4b18-9cae-777ee1a0f4d7 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:28.736323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b5709-0f62-4b18-9cae-777ee1a0f4d7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:28.736622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b5709-0f62-4b18-9cae-777ee1a0f4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:28.738001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b5709-0f62-4b18-9cae-777ee1a0f4d7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:28.742273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 642/1292] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Aug 4 02:26:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:30.723642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10759526-c8a2-4438-90f1-6acb8bb8cb5f None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:30.724223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10759526-c8a2-4438-90f1-6acb8bb8cb5f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:30.724223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10759526-c8a2-4438-90f1-6acb8bb8cb5f None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:30.725586 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 651/1293] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:26:30.730601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bce539-c772-456d-9bb7-8af25a5c3f9d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:30.731000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bce539-c772-456d-9bb7-8af25a5c3f9d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:30.731147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bce539-c772-456d-9bb7-8af25a5c3f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:30.748602 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-34bce539-c772-456d-9bb7-8af25a5c3f9d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:30.749813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-34bce539-c772-456d-9bb7-8af25a5c3f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:30.778504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:30.816434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 643/1294] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 02:26:30.838988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10759526-c8a2-4438-90f1-6acb8bb8cb5f None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:30.868434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:30.936898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10759526-c8a2-4438-90f1-6acb8bb8cb5f None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:30.969987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864b1ae-96cf-4422-ae78-e050d92043f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:30.970577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b1ae-96cf-4422-ae78-e050d92043f1 None admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:30.970851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b1ae-96cf-4422-ae78-e050d92043f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:30.971115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b1ae-96cf-4422-ae78-e050d92043f1 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:30.971784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864b1ae-96cf-4422-ae78-e050d92043f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:30.973107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864b1ae-96cf-4422-ae78-e050d92043f1 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:30.987318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 652/1295] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Aug 4 02:26:30 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:26:32.952219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a60d-5b7e-4e27-a1d3-b84fbdcf2600 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:32.952740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a60d-5b7e-4e27-a1d3-b84fbdcf2600 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:32.952740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a60d-5b7e-4e27-a1d3-b84fbdcf2600 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:32.954141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 644/1296] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:26:32.959089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded67737-1d6d-42fd-958f-f388b90b6f6e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:32.959481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded67737-1d6d-42fd-958f-f388b90b6f6e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:32.959640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded67737-1d6d-42fd-958f-f388b90b6f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:32.977072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ded67737-1d6d-42fd-958f-f388b90b6f6e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:32.978270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ded67737-1d6d-42fd-958f-f388b90b6f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:33.049119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 653/1297] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:26:33.071474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a60d-5b7e-4e27-a1d3-b84fbdcf2600 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:33.168831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a60d-5b7e-4e27-a1d3-b84fbdcf2600 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:33.201222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff39426-8e74-4128-8c67-e530f2c6b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:33.201868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff39426-8e74-4128-8c67-e530f2c6b563 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:33.202147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff39426-8e74-4128-8c67-e530f2c6b563 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:33.202460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff39426-8e74-4128-8c67-e530f2c6b563 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:33.203019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff39426-8e74-4128-8c67-e530f2c6b563 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:33.204370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff39426-8e74-4128-8c67-e530f2c6b563 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-6ff39426-8e74-4128-8c67-e530f2c6b563 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:33.212943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:33.214271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:33.215453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 645/1298] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:26:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:33.220391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded67737-1d6d-42fd-958f-f388b90b6f6e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:33.238708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:33.325307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded67737-1d6d-42fd-958f-f388b90b6f6e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:33.361497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ce477-ac21-44ef-ac55-e6f6a024a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:33.362112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce477-ac21-44ef-ac55-e6f6a024a9de None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:33.362392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce477-ac21-44ef-ac55-e6f6a024a9de None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:33.362660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce477-ac21-44ef-ac55-e6f6a024a9de None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:33.363322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ce477-ac21-44ef-ac55-e6f6a024a9de None admin] RBAC: Adding query filter params (name=placement) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:33.363651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ce477-ac21-44ef-ac55-e6f6a024a9de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:33.364975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ce477-ac21-44ef-ac55-e6f6a024a9de None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:33.370032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 654/1299] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Aug 4 02:26:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:33.376009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff39426-8e74-4128-8c67-e530f2c6b563 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:33.406895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:33.473039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff39426-8e74-4128-8c67-e530f2c6b563 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:33.504465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693a5af-d06e-43dc-9bf3-2f6b0f6fb95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:33.505052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693a5af-d06e-43dc-9bf3-2f6b0f6fb95a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:33.505341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693a5af-d06e-43dc-9bf3-2f6b0f6fb95a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:33.505640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693a5af-d06e-43dc-9bf3-2f6b0f6fb95a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:33.506351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693a5af-d06e-43dc-9bf3-2f6b0f6fb95a None admin] RBAC: Adding query filter params (interface=public, service_id=f804c888709a4146b408d59e02cfc95b, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:33.506649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693a5af-d06e-43dc-9bf3-2f6b0f6fb95a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:33.507991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693a5af-d06e-43dc-9bf3-2f6b0f6fb95a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:33.512782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 646/1300] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Aug 4 02:26:33 2022] GET /identity/v3/endpoints?service_id=f804c888709a4146b408d59e02cfc95b&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:33.518882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ce477-ac21-44ef-ac55-e6f6a024a9de None admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:33.600819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:33.619257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ce477-ac21-44ef-ac55-e6f6a024a9de None admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:33.652456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8abec-18e7-4a71-97aa-90b19dd36638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:33.653061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8abec-18e7-4a71-97aa-90b19dd36638 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:33.653361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8abec-18e7-4a71-97aa-90b19dd36638 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:33.653639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8abec-18e7-4a71-97aa-90b19dd36638 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:33.654310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8abec-18e7-4a71-97aa-90b19dd36638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:33.655664 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8abec-18e7-4a71-97aa-90b19dd36638 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:33.662332 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 655/1301] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Aug 4 02:26:33 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:26:35.617027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd218ce-1f97-448a-bae8-dc87eaa60dca None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:35.617515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd218ce-1f97-448a-bae8-dc87eaa60dca None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:35.617620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd218ce-1f97-448a-bae8-dc87eaa60dca None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:35.618937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 647/1302] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:26:35.624599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b90141-5c06-473b-ae92-df8d14289b86 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:35.625010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b90141-5c06-473b-ae92-df8d14289b86 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:35.625151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b90141-5c06-473b-ae92-df8d14289b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:35.644137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-c0b90141-5c06-473b-ae92-df8d14289b86 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:26:35.645317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c0b90141-5c06-473b-ae92-df8d14289b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:26:35.712387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 656/1303] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:26:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 02:26:35.735134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd218ce-1f97-448a-bae8-dc87eaa60dca None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:35.828027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:35.834853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd218ce-1f97-448a-bae8-dc87eaa60dca None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:35.867069 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a634b52-fed4-4441-ba98-8bd71472752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:35.867693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634b52-fed4-4441-ba98-8bd71472752f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:35.867971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634b52-fed4-4441-ba98-8bd71472752f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:35.868240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a634b52-fed4-4441-ba98-8bd71472752f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:35.868852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a634b52-fed4-4441-ba98-8bd71472752f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:35.870247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a634b52-fed4-4441-ba98-8bd71472752f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-6a634b52-fed4-4441-ba98-8bd71472752f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 02:26:35.879556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 02:26:35.880720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Aug 04 02:26:35.881707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 648/1304] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Aug 4 02:26:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 02:26:35.886540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b90141-5c06-473b-ae92-df8d14289b86 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:35.959989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:35.982839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b90141-5c06-473b-ae92-df8d14289b86 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:36.015540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840687f-f339-4fea-ada9-730648dc7fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:36.016139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840687f-f339-4fea-ada9-730648dc7fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:36.016412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840687f-f339-4fea-ada9-730648dc7fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:36.016678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840687f-f339-4fea-ada9-730648dc7fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:36.017508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840687f-f339-4fea-ada9-730648dc7fe5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:26:36.017667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840687f-f339-4fea-ada9-730648dc7fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:36.019000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840687f-f339-4fea-ada9-730648dc7fe5 None admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:36.024273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 657/1305] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Aug 4 02:26:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:26:36.029970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a634b52-fed4-4441-ba98-8bd71472752f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:26:36.128406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a634b52-fed4-4441-ba98-8bd71472752f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:26:36.161522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f50db-91bc-4c48-9098-965ea806a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:26:36.162113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f50db-91bc-4c48-9098-965ea806a080 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:26:36.162390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f50db-91bc-4c48-9098-965ea806a080 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:26:36.162660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f50db-91bc-4c48-9098-965ea806a080 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:26:36.163354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f50db-91bc-4c48-9098-965ea806a080 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:26:36.164702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f50db-91bc-4c48-9098-965ea806a080 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:26:36.184236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 649/1306] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:26:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:26:46.021067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=30 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:26:46.179782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:38.447866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69343c15-a588-4f46-8b56-7363ecf11d4c None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:38.449596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69343c15-a588-4f46-8b56-7363ecf11d4c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:38.450117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69343c15-a588-4f46-8b56-7363ecf11d4c None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:38.456901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17a1e-319b-42a1-881d-ace73232dfa1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:38.457770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17a1e-319b-42a1-881d-ace73232dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:38.458272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc17a1e-319b-42a1-881d-ace73232dfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:38.461621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 658/1307] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:27:38 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:38.543996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9dc17a1e-319b-42a1-881d-ace73232dfa1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:38.545795 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9dc17a1e-319b-42a1-881d-ace73232dfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:38.663566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 650/1308] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:38.715113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d56708-d62f-4574-ae67-f3b1362824e2 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:38.715441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d56708-d62f-4574-ae67-f3b1362824e2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:38.715632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d56708-d62f-4574-ae67-f3b1362824e2 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:38.717551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 659/1309] 10.222.0.69 () {54 vars in 965 bytes} [Thu Aug 4 02:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:38.723979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0b8a-afcc-4d23-a4a6-4445a6e66f4e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:38.724264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0b8a-afcc-4d23-a4a6-4445a6e66f4e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:38.724529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da0b8a-afcc-4d23-a4a6-4445a6e66f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:38.816817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e1da0b8a-afcc-4d23-a4a6-4445a6e66f4e None None] MFA Rules not processed for user `d110c27fc9c045ea9a4eb49b4dafe221`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:38.820888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e1da0b8a-afcc-4d23-a4a6-4445a6e66f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:38.847862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:38.914888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 651/1310] 10.222.0.69 () {58 vars in 1062 bytes} [Thu Aug 4 02:27:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:38.926220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d56708-d62f-4574-ae67-f3b1362824e2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:27:38.928467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-71d56708-d62f-4574-ae67-f3b1362824e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:39.148436 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d56708-d62f-4574-ae67-f3b1362824e2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:27:39.235115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76e678-a2d1-4d95-b0e0-361f43b4b213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:27:39.236053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76e678-a2d1-4d95-b0e0-361f43b4b213 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:39.236737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76e678-a2d1-4d95-b0e0-361f43b4b213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:39.237244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76e678-a2d1-4d95-b0e0-361f43b4b213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:39.239665 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fe76e678-a2d1-4d95-b0e0-361f43b4b213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:39.300304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:39.361060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76e678-a2d1-4d95-b0e0-361f43b4b213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:27:39.362824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76e678-a2d1-4d95-b0e0-361f43b4b213 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:27:39.386632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 660/1311] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:27:41.668909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8903-c94f-4790-a88e-7689e9839d4b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:41.669482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8903-c94f-4790-a88e-7689e9839d4b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:41.669590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8903-c94f-4790-a88e-7689e9839d4b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:41.670893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 652/1312] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:41.676144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889d83-b8e3-4048-ab7f-ae24f37181cf None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:41.676595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889d83-b8e3-4048-ab7f-ae24f37181cf None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:41.676706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889d83-b8e3-4048-ab7f-ae24f37181cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:41.764698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b7889d83-b8e3-4048-ab7f-ae24f37181cf None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:41.765998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b7889d83-b8e3-4048-ab7f-ae24f37181cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:41.869190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 661/1313] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:41.907873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8903-c94f-4790-a88e-7689e9839d4b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:27:41.909485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-273c8903-c94f-4790-a88e-7689e9839d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:42.010635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8903-c94f-4790-a88e-7689e9839d4b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:27:42.081836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:42.084412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610a151-df6f-4c7b-9dd1-ced281c6043e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:27:42.085027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610a151-df6f-4c7b-9dd1-ced281c6043e service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:42.085588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610a151-df6f-4c7b-9dd1-ced281c6043e service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:42.086092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610a151-df6f-4c7b-9dd1-ced281c6043e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:42.087932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8610a151-df6f-4c7b-9dd1-ced281c6043e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:42.200524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610a151-df6f-4c7b-9dd1-ced281c6043e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:27:42.201998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610a151-df6f-4c7b-9dd1-ced281c6043e service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:27:42.220417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 653/1314] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:27:44.547579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d738-b4d6-439e-b136-ba857ef523b0 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:44.548119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d738-b4d6-439e-b136-ba857ef523b0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:44.548119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55d738-b4d6-439e-b136-ba857ef523b0 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:44.549533 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 662/1315] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:44.554821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a947d9-6cdb-4d3e-af9f-b6febe10599b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:44.555256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a947d9-6cdb-4d3e-af9f-b6febe10599b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:44.555400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a947d9-6cdb-4d3e-af9f-b6febe10599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:44.624535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-46a947d9-6cdb-4d3e-af9f-b6febe10599b None None] MFA Rules not processed for user `4fa4130cd11045fca9174faec75a53cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:44.625779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-46a947d9-6cdb-4d3e-af9f-b6febe10599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:44.682672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:44.729074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 654/1316] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:27:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:44.784263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5001f0-e7b2-4c3e-a92d-ff807a6752bc None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:44.784542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5001f0-e7b2-4c3e-a92d-ff807a6752bc None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:44.784838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5001f0-e7b2-4c3e-a92d-ff807a6752bc None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:44.786224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 663/1317] 10.222.0.69 () {54 vars in 965 bytes} [Thu Aug 4 02:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:44.792795 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346ff9-924c-4173-b5e1-ba4b5e181444 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:44.793076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346ff9-924c-4173-b5e1-ba4b5e181444 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:44.793367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346ff9-924c-4173-b5e1-ba4b5e181444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:44.867572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4d346ff9-924c-4173-b5e1-ba4b5e181444 None None] MFA Rules not processed for user `d110c27fc9c045ea9a4eb49b4dafe221`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:44.868778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4d346ff9-924c-4173-b5e1-ba4b5e181444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:44.945523 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 655/1318] 10.222.0.69 () {58 vars in 1062 bytes} [Thu Aug 4 02:27:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:44.954679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5001f0-e7b2-4c3e-a92d-ff807a6752bc None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:27:44.956209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bd5001f0-e7b2-4c3e-a92d-ff807a6752bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:44.966599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:45.060072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5001f0-e7b2-4c3e-a92d-ff807a6752bc None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:27:45.130126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4b318-81c0-46b2-ac86-13bc845de948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:27:45.130660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4b318-81c0-46b2-ac86-13bc845de948 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:45.130933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4b318-81c0-46b2-ac86-13bc845de948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:45.131200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4b318-81c0-46b2-ac86-13bc845de948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:45.132804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a3c4b318-81c0-46b2-ac86-13bc845de948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:45.193613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:45.240121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4b318-81c0-46b2-ac86-13bc845de948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:27:45.241581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4b318-81c0-46b2-ac86-13bc845de948 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:27:45.259914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 664/1319] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:27:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:27:48.166181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663571-670b-4dd2-a929-cbebd57adc8c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:48.166647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663571-670b-4dd2-a929-cbebd57adc8c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:48.166740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663571-670b-4dd2-a929-cbebd57adc8c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:48.168740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 656/1320] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:48.174069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184bf15-5356-4a72-ae82-60ae3631897d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:48.174462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184bf15-5356-4a72-ae82-60ae3631897d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:48.174623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184bf15-5356-4a72-ae82-60ae3631897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:48.240234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3184bf15-5356-4a72-ae82-60ae3631897d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:48.241467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3184bf15-5356-4a72-ae82-60ae3631897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:48.335317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 665/1321] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:27:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:48.375034 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663571-670b-4dd2-a929-cbebd57adc8c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:27:48.376614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d9663571-670b-4dd2-a929-cbebd57adc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:48.426160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:48.479225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663571-670b-4dd2-a929-cbebd57adc8c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:27:48.551145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58540328-28bb-4a83-975b-569ec7869e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:27:48.551754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58540328-28bb-4a83-975b-569ec7869e0a service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:48.552031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58540328-28bb-4a83-975b-569ec7869e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:48.552299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58540328-28bb-4a83-975b-569ec7869e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:48.553928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-58540328-28bb-4a83-975b-569ec7869e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:48.648547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:48.661549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58540328-28bb-4a83-975b-569ec7869e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:27:48.662982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58540328-28bb-4a83-975b-569ec7869e0a service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:27:48.681002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 657/1322] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:27:51.355208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29fac-8e40-4c1e-973d-3898708d0750 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:51.355770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29fac-8e40-4c1e-973d-3898708d0750 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:51.355770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29fac-8e40-4c1e-973d-3898708d0750 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:51.357116 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 666/1323] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:51.362275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860b8d5-1dcc-4618-80a1-928fda34938e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:51.362705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860b8d5-1dcc-4618-80a1-928fda34938e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:51.362830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860b8d5-1dcc-4618-80a1-928fda34938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:51.431281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d860b8d5-1dcc-4618-80a1-928fda34938e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:51.432492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d860b8d5-1dcc-4618-80a1-928fda34938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:51.540085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 658/1324] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:51.577235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a29fac-8e40-4c1e-973d-3898708d0750 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:27:51.578820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-47a29fac-8e40-4c1e-973d-3898708d0750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:51.600017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:51.685167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a29fac-8e40-4c1e-973d-3898708d0750 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:27:51.757686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee7a78-d98b-44fe-a5ef-582a67b1cf45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:27:51.758294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee7a78-d98b-44fe-a5ef-582a67b1cf45 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:51.758571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee7a78-d98b-44fe-a5ef-582a67b1cf45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:51.758840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee7a78-d98b-44fe-a5ef-582a67b1cf45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:51.760465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-aeee7a78-d98b-44fe-a5ef-582a67b1cf45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:51.831640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:51.870404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee7a78-d98b-44fe-a5ef-582a67b1cf45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:27:51.871731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee7a78-d98b-44fe-a5ef-582a67b1cf45 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:27:51.890484 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 667/1325] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:27:53.934558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb43178-fbb5-4deb-bb35-e604e015b8e3 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:53.935093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb43178-fbb5-4deb-bb35-e604e015b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:53.935093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb43178-fbb5-4deb-bb35-e604e015b8e3 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:53.936464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 659/1326] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:53.941795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06284d6c-b084-4301-a251-7a78f3eb6a11 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:53.942215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06284d6c-b084-4301-a251-7a78f3eb6a11 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:53.942345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06284d6c-b084-4301-a251-7a78f3eb6a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:54.007849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-06284d6c-b084-4301-a251-7a78f3eb6a11 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:54.009343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-06284d6c-b084-4301-a251-7a78f3eb6a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:54.107257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 668/1327] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:54.142402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb43178-fbb5-4deb-bb35-e604e015b8e3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:27:54.143929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5fb43178-fbb5-4deb-bb35-e604e015b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:54.205590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:54.248902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb43178-fbb5-4deb-bb35-e604e015b8e3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:27:54.329281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5025a-082d-4a62-94cf-563a5a988ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:27:54.329922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5025a-082d-4a62-94cf-563a5a988ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:54.330200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5025a-082d-4a62-94cf-563a5a988ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:54.330472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5025a-082d-4a62-94cf-563a5a988ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:54.332077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-48b5025a-082d-4a62-94cf-563a5a988ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:54.437919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:54.440288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5025a-082d-4a62-94cf-563a5a988ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:27:54.441783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5025a-082d-4a62-94cf-563a5a988ce4 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:27:54.460594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 660/1328] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:27:56.513759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d82c-4783-4597-bace-029ac3e31e3e None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:56.514295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d82c-4783-4597-bace-029ac3e31e3e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:56.514295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216d82c-4783-4597-bace-029ac3e31e3e None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:56.515910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 669/1329] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:56.521147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb4cfd-3929-4a78-a9a9-9934a5d2e2af None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:56.521616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb4cfd-3929-4a78-a9a9-9934a5d2e2af None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:56.521738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb4cfd-3929-4a78-a9a9-9934a5d2e2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:56.594823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-84fb4cfd-3929-4a78-a9a9-9934a5d2e2af None None] MFA Rules not processed for user `4fa4130cd11045fca9174faec75a53cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:56.596044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-84fb4cfd-3929-4a78-a9a9-9934a5d2e2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:56.697015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 661/1330] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:27:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:56.735656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216d82c-4783-4597-bace-029ac3e31e3e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:27:56.737210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e216d82c-4783-4597-bace-029ac3e31e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:56.768178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:56.842749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216d82c-4783-4597-bace-029ac3e31e3e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:27:56.916775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7123e96-0fe8-46c4-8a48-74d32221ea43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:27:56.917425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7123e96-0fe8-46c4-8a48-74d32221ea43 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:56.917708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7123e96-0fe8-46c4-8a48-74d32221ea43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:56.917986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7123e96-0fe8-46c4-8a48-74d32221ea43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:56.919631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a7123e96-0fe8-46c4-8a48-74d32221ea43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:56.997277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:57.029227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7123e96-0fe8-46c4-8a48-74d32221ea43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:27:57.030625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7123e96-0fe8-46c4-8a48-74d32221ea43 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:27:57.049440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 670/1331] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:27:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:27:59.317743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf08148-6db1-490e-bcfa-da62288c0fa2 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:59.318245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf08148-6db1-490e-bcfa-da62288c0fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:59.318367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf08148-6db1-490e-bcfa-da62288c0fa2 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:59.319653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 662/1332] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:27:59.324687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bdf88-ec38-4508-b81c-a4f6835960bb None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:59.325078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bdf88-ec38-4508-b81c-a4f6835960bb None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:59.325241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bdf88-ec38-4508-b81c-a4f6835960bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:59.389580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-257bdf88-ec38-4508-b81c-a4f6835960bb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:27:59.390768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-257bdf88-ec38-4508-b81c-a4f6835960bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:59.484699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 671/1333] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:27:59.519578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf08148-6db1-490e-bcfa-da62288c0fa2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:27:59.521097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cbf08148-6db1-490e-bcfa-da62288c0fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:59.591416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:59.625688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf08148-6db1-490e-bcfa-da62288c0fa2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:27:59.697203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2c13-e936-4f31-b068-1a90c70ee614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:27:59.698350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2c13-e936-4f31-b068-1a90c70ee614 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:27:59.698629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2c13-e936-4f31-b068-1a90c70ee614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:27:59.698894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2c13-e936-4f31-b068-1a90c70ee614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:27:59.700471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-215f2c13-e936-4f31-b068-1a90c70ee614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:27:59.806548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2c13-e936-4f31-b068-1a90c70ee614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:27:59.807971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2c13-e936-4f31-b068-1a90c70ee614 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:27:59.817861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:27:59.826887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 663/1334] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:01.860974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb84c12-9bbd-4d59-ba0b-be684fd62b9d None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:01.861608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb84c12-9bbd-4d59-ba0b-be684fd62b9d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:01.861608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb84c12-9bbd-4d59-ba0b-be684fd62b9d None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:01.862824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 672/1335] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:01.868030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd9890-0933-4580-9da7-48efa8948ee4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:01.868464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd9890-0933-4580-9da7-48efa8948ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:01.868569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd9890-0933-4580-9da7-48efa8948ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:01.933642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7afd9890-0933-4580-9da7-48efa8948ee4 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:01.934837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7afd9890-0933-4580-9da7-48efa8948ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:02.029025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 664/1336] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:02.068816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb84c12-9bbd-4d59-ba0b-be684fd62b9d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:02.070389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-efb84c12-9bbd-4d59-ba0b-be684fd62b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:02.111116 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:02.173412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb84c12-9bbd-4d59-ba0b-be684fd62b9d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:02.243522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c785ae2-91bd-42c1-a794-449825b47c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:02.244128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c785ae2-91bd-42c1-a794-449825b47c5c service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:02.244400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c785ae2-91bd-42c1-a794-449825b47c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:02.244691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c785ae2-91bd-42c1-a794-449825b47c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:02.246312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7c785ae2-91bd-42c1-a794-449825b47c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:02.328359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:02.353402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c785ae2-91bd-42c1-a794-449825b47c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:02.354784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c785ae2-91bd-42c1-a794-449825b47c5c service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:02.372700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 673/1337] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:04.693231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feae46-4a8f-48d3-9e79-6b65d85b6c84 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:04.693815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feae46-4a8f-48d3-9e79-6b65d85b6c84 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:04.693939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feae46-4a8f-48d3-9e79-6b65d85b6c84 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:04.695299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 665/1338] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:04.701104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f112331-1dd6-4a64-890f-841412b7f0bf None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:04.701571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f112331-1dd6-4a64-890f-841412b7f0bf None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:04.701708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f112331-1dd6-4a64-890f-841412b7f0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:04.767919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8f112331-1dd6-4a64-890f-841412b7f0bf None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:04.769108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8f112331-1dd6-4a64-890f-841412b7f0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:04.863638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 674/1339] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:04.899848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feae46-4a8f-48d3-9e79-6b65d85b6c84 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:04.901517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e8feae46-4a8f-48d3-9e79-6b65d85b6c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:04.976847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:05.005171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feae46-4a8f-48d3-9e79-6b65d85b6c84 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:05.076882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9ea1d-f836-4b86-b3f3-ba871473b200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:05.077517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9ea1d-f836-4b86-b3f3-ba871473b200 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:05.077798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9ea1d-f836-4b86-b3f3-ba871473b200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:05.078071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9ea1d-f836-4b86-b3f3-ba871473b200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:05.079660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-09c9ea1d-f836-4b86-b3f3-ba871473b200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:05.186213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9ea1d-f836-4b86-b3f3-ba871473b200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:05.187648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9ea1d-f836-4b86-b3f3-ba871473b200 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:05.205202 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 666/1340] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:09.124887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7c402-436e-4c29-b9bf-5dc94b3e84d2 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:09.125551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7c402-436e-4c29-b9bf-5dc94b3e84d2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:09.125551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7c402-436e-4c29-b9bf-5dc94b3e84d2 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:09.127684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 675/1341] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:09.132986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0120f7a-ea3c-4dde-a06e-4316deb1a735 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:09.133891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0120f7a-ea3c-4dde-a06e-4316deb1a735 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:09.134177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0120f7a-ea3c-4dde-a06e-4316deb1a735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:09.139605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:09.204324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d0120f7a-ea3c-4dde-a06e-4316deb1a735 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:09.205915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d0120f7a-ea3c-4dde-a06e-4316deb1a735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:09.308480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 667/1342] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:09.347362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7c402-436e-4c29-b9bf-5dc94b3e84d2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:09.348979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c5f7c402-436e-4c29-b9bf-5dc94b3e84d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:09.397823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:09.454875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7c402-436e-4c29-b9bf-5dc94b3e84d2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:09.529141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155333b-acdc-4788-99d9-2cf70705612d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:09.529782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155333b-acdc-4788-99d9-2cf70705612d service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:09.530057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155333b-acdc-4788-99d9-2cf70705612d service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:09.530328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155333b-acdc-4788-99d9-2cf70705612d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:09.531989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8155333b-acdc-4788-99d9-2cf70705612d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:09.629489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:09.646793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155333b-acdc-4788-99d9-2cf70705612d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:09.648284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155333b-acdc-4788-99d9-2cf70705612d service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:09.666897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 676/1343] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:12.301938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4c732-7524-4c54-a940-bdec82ab9030 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:12.302504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4c732-7524-4c54-a940-bdec82ab9030 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:12.302504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4c732-7524-4c54-a940-bdec82ab9030 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:12.303919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 668/1344] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:12.309747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3306c36-2cdc-47df-a623-ef00b3e73b38 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:12.310177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3306c36-2cdc-47df-a623-ef00b3e73b38 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:12.310296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3306c36-2cdc-47df-a623-ef00b3e73b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:12.378677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b3306c36-2cdc-47df-a623-ef00b3e73b38 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:12.379887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b3306c36-2cdc-47df-a623-ef00b3e73b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:12.476739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 677/1345] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:12.514635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4c732-7524-4c54-a940-bdec82ab9030 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:12.516157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5fe4c732-7524-4c54-a940-bdec82ab9030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:12.605455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:12.624521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4c732-7524-4c54-a940-bdec82ab9030 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:12.700747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43f35-7d13-47c4-9697-ab29f2463531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:12.701386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43f35-7d13-47c4-9697-ab29f2463531 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:12.701669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43f35-7d13-47c4-9697-ab29f2463531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:12.701938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43f35-7d13-47c4-9697-ab29f2463531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:12.703554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a8b43f35-7d13-47c4-9697-ab29f2463531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:12.814623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b43f35-7d13-47c4-9697-ab29f2463531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:12.815976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b43f35-7d13-47c4-9697-ab29f2463531 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:12.834700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 669/1346] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:16.771031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f036c-8a32-4922-99fc-72cdb2b4a3d4 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:16.771841 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f036c-8a32-4922-99fc-72cdb2b4a3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:16.771935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f036c-8a32-4922-99fc-72cdb2b4a3d4 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:16.773272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 678/1347] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:16.778633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800620c-56ee-43e8-ae4a-9ab244d45086 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:16.779049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800620c-56ee-43e8-ae4a-9ab244d45086 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:16.779214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800620c-56ee-43e8-ae4a-9ab244d45086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:16.794615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:16.846240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3800620c-56ee-43e8-ae4a-9ab244d45086 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:16.847484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3800620c-56ee-43e8-ae4a-9ab244d45086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:16.949015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 670/1348] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:16.988762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f036c-8a32-4922-99fc-72cdb2b4a3d4 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:16.990382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4c8f036c-8a32-4922-99fc-72cdb2b4a3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:17.057952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:17.106810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f036c-8a32-4922-99fc-72cdb2b4a3d4 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:17.184619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a22a7-9234-4e19-a6a7-4861aa3140f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:17.185247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a22a7-9234-4e19-a6a7-4861aa3140f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:17.185561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a22a7-9234-4e19-a6a7-4861aa3140f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:17.185838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a22a7-9234-4e19-a6a7-4861aa3140f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:17.187505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c42a22a7-9234-4e19-a6a7-4861aa3140f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:17.301246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:17.306092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a22a7-9234-4e19-a6a7-4861aa3140f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:17.308064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a22a7-9234-4e19-a6a7-4861aa3140f1 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:17.327679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 679/1349] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:22.217313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c11977-97d9-4acf-ba6d-ebf42347bf37 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:22.218098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c11977-97d9-4acf-ba6d-ebf42347bf37 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:22.218098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c11977-97d9-4acf-ba6d-ebf42347bf37 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:22.219350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 671/1350] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:22.224478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff829367-b002-47f3-a296-bc30d5c74973 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:22.225347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff829367-b002-47f3-a296-bc30d5c74973 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:22.225896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff829367-b002-47f3-a296-bc30d5c74973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:22.309867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ff829367-b002-47f3-a296-bc30d5c74973 None None] MFA Rules not processed for user `234cbff2a729458a8dad108baaba6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:22.311439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ff829367-b002-47f3-a296-bc30d5c74973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:22.442565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 680/1351] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:28:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:26.390032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c1d89-76c8-4684-92a8-131978bc72a4 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:26.390883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c1d89-76c8-4684-92a8-131978bc72a4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:26.391160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c1d89-76c8-4684-92a8-131978bc72a4 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:26.392525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 672/1352] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:26.397757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24775f96-e042-4b95-a9d8-1d4460890b1e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:26.398162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24775f96-e042-4b95-a9d8-1d4460890b1e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:26.398260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24775f96-e042-4b95-a9d8-1d4460890b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:26.459772 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:26.487874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-24775f96-e042-4b95-a9d8-1d4460890b1e None None] MFA Rules not processed for user `234cbff2a729458a8dad108baaba6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:26.489699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-24775f96-e042-4b95-a9d8-1d4460890b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:26.624486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 681/1353] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:28:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:26.951441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=59 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:28.086071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5af816-bfc8-4ad2-b3e7-3107a55d754e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:28.086722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5af816-bfc8-4ad2-b3e7-3107a55d754e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:28.086722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5af816-bfc8-4ad2-b3e7-3107a55d754e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:28.088478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 673/1354] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:28.093687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47b61-101d-458c-b9c4-ef61883436b5 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:28.094096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47b61-101d-458c-b9c4-ef61883436b5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:28.094387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47b61-101d-458c-b9c4-ef61883436b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:28.173321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b1e47b61-101d-458c-b9c4-ef61883436b5 None None] MFA Rules not processed for user `234cbff2a729458a8dad108baaba6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:28.174561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b1e47b61-101d-458c-b9c4-ef61883436b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:28.216486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:28.282481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 682/1355] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:28:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:28:31.627310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7b9a6-0c49-4900-9219-5f6938c12571 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:31.628254 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7b9a6-0c49-4900-9219-5f6938c12571 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:31.628735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7b9a6-0c49-4900-9219-5f6938c12571 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:31.635160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 674/1356] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:31.636301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329a257-0f16-49ce-8c8e-ed5c35405785 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:31.637243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329a257-0f16-49ce-8c8e-ed5c35405785 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:31.637810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329a257-0f16-49ce-8c8e-ed5c35405785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:31.716886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-1329a257-0f16-49ce-8c8e-ed5c35405785 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:31.718130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1329a257-0f16-49ce-8c8e-ed5c35405785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:31.822923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 683/1357] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:31.876033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657136-f8bc-4e7b-8260-4ad6ef15746c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:31.876643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657136-f8bc-4e7b-8260-4ad6ef15746c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:31.877040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657136-f8bc-4e7b-8260-4ad6ef15746c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:31.878617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 675/1358] 10.222.0.69 () {54 vars in 962 bytes} [Thu Aug 4 02:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:31.896281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ce311-90c5-41d6-a11d-9c1e0981644f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:31.896802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ce311-90c5-41d6-a11d-9c1e0981644f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:31.897397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ce311-90c5-41d6-a11d-9c1e0981644f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:31.920016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:31.988633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-077ce311-90c5-41d6-a11d-9c1e0981644f None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:31.989883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-077ce311-90c5-41d6-a11d-9c1e0981644f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:32.110697 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 684/1359] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Aug 4 02:28:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:32.118968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657136-f8bc-4e7b-8260-4ad6ef15746c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:32.120468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-59657136-f8bc-4e7b-8260-4ad6ef15746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:32.275367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657136-f8bc-4e7b-8260-4ad6ef15746c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:32.354481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:32.396473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d340cf-fb87-4e0a-8443-451f3b1be826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:32.397006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d340cf-fb87-4e0a-8443-451f3b1be826 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:32.397287 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d340cf-fb87-4e0a-8443-451f3b1be826 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:32.397591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d340cf-fb87-4e0a-8443-451f3b1be826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:32.399312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-30d340cf-fb87-4e0a-8443-451f3b1be826 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:32.508233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d340cf-fb87-4e0a-8443-451f3b1be826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:32.510015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d340cf-fb87-4e0a-8443-451f3b1be826 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:32.529366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 676/1360] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:28:34.743285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df578-322a-44a1-afde-8d1cc55ff3d6 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:34.743806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df578-322a-44a1-afde-8d1cc55ff3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:34.743806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df578-322a-44a1-afde-8d1cc55ff3d6 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:34.745172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 685/1361] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:34.750338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9953-152c-443f-a2de-ddeb0b9ddb95 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:34.750752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9953-152c-443f-a2de-ddeb0b9ddb95 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:34.750893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9953-152c-443f-a2de-ddeb0b9ddb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:34.820710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-500c9953-152c-443f-a2de-ddeb0b9ddb95 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:34.822078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-500c9953-152c-443f-a2de-ddeb0b9ddb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:34.862408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:34.933619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 677/1362] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:34.975792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df578-322a-44a1-afde-8d1cc55ff3d6 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:34.978505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d55df578-322a-44a1-afde-8d1cc55ff3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:35.057528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:35.146495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df578-322a-44a1-afde-8d1cc55ff3d6 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:35.284833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b53f7-2990-4921-bcd5-01061b846ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:35.285538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b53f7-2990-4921-bcd5-01061b846ee1 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:35.285822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b53f7-2990-4921-bcd5-01061b846ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:35.286097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b53f7-2990-4921-bcd5-01061b846ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:35.287758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2d3b53f7-2990-4921-bcd5-01061b846ee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:35.312103 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:35.382726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b53f7-2990-4921-bcd5-01061b846ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:35.384935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b53f7-2990-4921-bcd5-01061b846ee1 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:35.403979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 686/1363] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:28:37.780297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57922e03-9315-4a85-9841-5b1e1640775f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:37.780872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57922e03-9315-4a85-9841-5b1e1640775f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:37.780872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57922e03-9315-4a85-9841-5b1e1640775f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:37.782691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 678/1364] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:37.788088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d740c-cb04-4970-af9d-1beda0093cb1 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:37.788907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d740c-cb04-4970-af9d-1beda0093cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:37.789482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d740c-cb04-4970-af9d-1beda0093cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:37.861747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ac8d740c-cb04-4970-af9d-1beda0093cb1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:37.862966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ac8d740c-cb04-4970-af9d-1beda0093cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:38.003891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:38.007064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 687/1365] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:38.069588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c5a2f-be91-4cb7-8a08-1572b3095e7f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:38.069588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c5a2f-be91-4cb7-8a08-1572b3095e7f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:38.069588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c5a2f-be91-4cb7-8a08-1572b3095e7f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:38.069588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 679/1366] 10.222.0.69 () {54 vars in 962 bytes} [Thu Aug 4 02:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:38.078369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6b607-ba2f-4ba1-8fb9-bba84d8cc333 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:38.078662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6b607-ba2f-4ba1-8fb9-bba84d8cc333 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:38.078940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6b607-ba2f-4ba1-8fb9-bba84d8cc333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:38.170085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b4b6b607-ba2f-4ba1-8fb9-bba84d8cc333 None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:38.173215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b4b6b607-ba2f-4ba1-8fb9-bba84d8cc333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:38.322761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 688/1367] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Aug 4 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:38.331908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c5a2f-be91-4cb7-8a08-1572b3095e7f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:38.333620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ea2c5a2f-be91-4cb7-8a08-1572b3095e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:38.489223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c5a2f-be91-4cb7-8a08-1572b3095e7f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:38.513228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:38.622158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97278a64-28c2-4cfe-9b8a-66301bbe49b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:38.622770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97278a64-28c2-4cfe-9b8a-66301bbe49b5 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:38.623043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97278a64-28c2-4cfe-9b8a-66301bbe49b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:38.623307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97278a64-28c2-4cfe-9b8a-66301bbe49b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:38.624904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-97278a64-28c2-4cfe-9b8a-66301bbe49b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:38.721608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97278a64-28c2-4cfe-9b8a-66301bbe49b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:38.723253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97278a64-28c2-4cfe-9b8a-66301bbe49b5 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:38.746827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 680/1368] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:39.619448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2c0f-64cc-450f-ab6d-f11e18ccf6a9 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:39.619981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2c0f-64cc-450f-ab6d-f11e18ccf6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:39.619981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2c0f-64cc-450f-ab6d-f11e18ccf6a9 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:39.621526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 689/1369] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:39.626416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081a0e-1bf7-4083-88f0-9decfbdbee4b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:39.626804 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081a0e-1bf7-4083-88f0-9decfbdbee4b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:39.626986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081a0e-1bf7-4083-88f0-9decfbdbee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:39.660457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:39.697652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d7081a0e-1bf7-4083-88f0-9decfbdbee4b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:39.698870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d7081a0e-1bf7-4083-88f0-9decfbdbee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:39.799646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 681/1370] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:40.140979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99358244-ffe9-41d0-91e9-a6bda28cfabd None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:40.140979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99358244-ffe9-41d0-91e9-a6bda28cfabd None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:40.140979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99358244-ffe9-41d0-91e9-a6bda28cfabd None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:40.143453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 690/1371] 10.222.0.69 () {54 vars in 964 bytes} [Thu Aug 4 02:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:40.147464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7249c-1d96-44a5-a45c-e75b6d2f8a38 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:40.147748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7249c-1d96-44a5-a45c-e75b6d2f8a38 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:40.148019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7249c-1d96-44a5-a45c-e75b6d2f8a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:40.227991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f1e7249c-1d96-44a5-a45c-e75b6d2f8a38 None None] MFA Rules not processed for user `e7b8eac1856c4e7f86fe1dea9f752719`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:40.228558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f1e7249c-1d96-44a5-a45c-e75b6d2f8a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:40.278162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:40.311717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 682/1372] 10.222.0.69 () {58 vars in 1061 bytes} [Thu Aug 4 02:28:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:40.319104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99358244-ffe9-41d0-91e9-a6bda28cfabd None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:40.320659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-99358244-ffe9-41d0-91e9-a6bda28cfabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:40.372924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:40.432395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99358244-ffe9-41d0-91e9-a6bda28cfabd None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:40.524250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabfe26-2267-4a44-a7cf-9d22af098627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:40.525851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabfe26-2267-4a44-a7cf-9d22af098627 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:40.526346 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabfe26-2267-4a44-a7cf-9d22af098627 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:40.526860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabfe26-2267-4a44-a7cf-9d22af098627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:40.528914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-5cabfe26-2267-4a44-a7cf-9d22af098627 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:40.646419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:40.661086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabfe26-2267-4a44-a7cf-9d22af098627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:40.662849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabfe26-2267-4a44-a7cf-9d22af098627 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:40.683579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 691/1373] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:40.845930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d49693-91d1-45ae-a914-abad32d79aaf None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:40.846366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d49693-91d1-45ae-a914-abad32d79aaf None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:40.846583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d49693-91d1-45ae-a914-abad32d79aaf None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:40.848223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 683/1374] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:40.854615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec014ae-8dfd-4b72-90ed-2babed410308 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:40.854950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec014ae-8dfd-4b72-90ed-2babed410308 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:40.855262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec014ae-8dfd-4b72-90ed-2babed410308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:40.927545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bec014ae-8dfd-4b72-90ed-2babed410308 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:40.928785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bec014ae-8dfd-4b72-90ed-2babed410308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:41.037550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 692/1375] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:41.086020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d49693-91d1-45ae-a914-abad32d79aaf None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:41.088380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-12d49693-91d1-45ae-a914-abad32d79aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:41.236180 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d49693-91d1-45ae-a914-abad32d79aaf None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:41.289711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:41.360036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437f3c2-5e72-4789-8861-b35ba7b4fc3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:41.360648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f3c2-5e72-4789-8861-b35ba7b4fc3e service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:41.360920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f3c2-5e72-4789-8861-b35ba7b4fc3e service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:41.361192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f3c2-5e72-4789-8861-b35ba7b4fc3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:41.362860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5437f3c2-5e72-4789-8861-b35ba7b4fc3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:41.455006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437f3c2-5e72-4789-8861-b35ba7b4fc3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:41.456686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437f3c2-5e72-4789-8861-b35ba7b4fc3e service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:41.479123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 684/1376] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:43.501950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502f12c-268e-4889-8e4e-9feb5a0b85d7 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:43.502452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502f12c-268e-4889-8e4e-9feb5a0b85d7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:43.502672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502f12c-268e-4889-8e4e-9feb5a0b85d7 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:43.503856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 693/1377] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:43.509774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed50b09-4278-4915-b3f5-c5878e1e6f18 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:43.510186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed50b09-4278-4915-b3f5-c5878e1e6f18 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:43.510296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed50b09-4278-4915-b3f5-c5878e1e6f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:43.587857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1ed50b09-4278-4915-b3f5-c5878e1e6f18 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:43.589055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1ed50b09-4278-4915-b3f5-c5878e1e6f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:43.595637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:43.723830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 685/1378] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:43.767855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502f12c-268e-4889-8e4e-9feb5a0b85d7 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:43.769504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4502f12c-268e-4889-8e4e-9feb5a0b85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:43.830571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:43.916595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502f12c-268e-4889-8e4e-9feb5a0b85d7 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:44.049206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afe162-3504-41ab-a324-790a832e30ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:44.050002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe162-3504-41ab-a324-790a832e30ff service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:44.050283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe162-3504-41ab-a324-790a832e30ff service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:44.050564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe162-3504-41ab-a324-790a832e30ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:44.052203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-14afe162-3504-41ab-a324-790a832e30ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:44.071098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:44.165968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afe162-3504-41ab-a324-790a832e30ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:44.168284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afe162-3504-41ab-a324-790a832e30ff service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:44.190383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 694/1379] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:46.257211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb429dd-2ac8-4c1f-8739-f0b5ad416f02 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:46.257788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb429dd-2ac8-4c1f-8739-f0b5ad416f02 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:46.258036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb429dd-2ac8-4c1f-8739-f0b5ad416f02 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:46.259691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 686/1380] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:46.264818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f70e-8edc-4aa2-9f1e-7f5e1d529169 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:46.265255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f70e-8edc-4aa2-9f1e-7f5e1d529169 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:46.265378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0f70e-8edc-4aa2-9f1e-7f5e1d529169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:46.340447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2dd0f70e-8edc-4aa2-9f1e-7f5e1d529169 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:46.341696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2dd0f70e-8edc-4aa2-9f1e-7f5e1d529169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:46.437999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:46.447218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 695/1381] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:46.492309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb429dd-2ac8-4c1f-8739-f0b5ad416f02 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:46.494608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3cb429dd-2ac8-4c1f-8739-f0b5ad416f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:46.641432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:46.654440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb429dd-2ac8-4c1f-8739-f0b5ad416f02 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:46.776406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc2800-edbe-48db-bdb6-5363aa536f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:46.777209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc2800-edbe-48db-bdb6-5363aa536f16 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:46.777606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc2800-edbe-48db-bdb6-5363aa536f16 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:46.777976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc2800-edbe-48db-bdb6-5363aa536f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:46.779684 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bfbc2800-edbe-48db-bdb6-5363aa536f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:46.873237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc2800-edbe-48db-bdb6-5363aa536f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:46.875022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc2800-edbe-48db-bdb6-5363aa536f16 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:46.886627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:46.895962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 687/1382] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:48.948504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7a8e-e04a-46c2-868e-a918e06685a5 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:48.949177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7a8e-e04a-46c2-868e-a918e06685a5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:48.949177 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7a8e-e04a-46c2-868e-a918e06685a5 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:48.950482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 696/1383] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:48.955569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6180c-9e9a-4780-b89f-599dc38e9a41 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:48.956015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6180c-9e9a-4780-b89f-599dc38e9a41 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:48.956122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6180c-9e9a-4780-b89f-599dc38e9a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:49.033599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d1f6180c-9e9a-4780-b89f-599dc38e9a41 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:49.034887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d1f6180c-9e9a-4780-b89f-599dc38e9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:49.132634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 688/1384] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:49.178157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e7a8e-e04a-46c2-868e-a918e06685a5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:49.179723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-811e7a8e-e04a-46c2-868e-a918e06685a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:49.331771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e7a8e-e04a-46c2-868e-a918e06685a5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:49.399021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:49.446656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da80ab-6bf1-4f31-a2a6-4be2622b9cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:49.447439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da80ab-6bf1-4f31-a2a6-4be2622b9cb1 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:49.447788 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da80ab-6bf1-4f31-a2a6-4be2622b9cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:49.448136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da80ab-6bf1-4f31-a2a6-4be2622b9cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:49.450395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-18da80ab-6bf1-4f31-a2a6-4be2622b9cb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:49.551237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da80ab-6bf1-4f31-a2a6-4be2622b9cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:49.552738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da80ab-6bf1-4f31-a2a6-4be2622b9cb1 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:49.577018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 697/1385] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:51.564266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c39198-464b-40f9-9b9d-de6a447e7903 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:51.564810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c39198-464b-40f9-9b9d-de6a447e7903 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:51.564972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c39198-464b-40f9-9b9d-de6a447e7903 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:51.566805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 689/1386] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:51.574350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38495fa7-bf0e-4065-abf6-b5f6d3fe1725 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:51.574350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38495fa7-bf0e-4065-abf6-b5f6d3fe1725 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:51.574883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38495fa7-bf0e-4065-abf6-b5f6d3fe1725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:51.652721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-38495fa7-bf0e-4065-abf6-b5f6d3fe1725 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:51.654259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-38495fa7-bf0e-4065-abf6-b5f6d3fe1725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:51.697532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:51.778358 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 698/1387] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:51.831395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c39198-464b-40f9-9b9d-de6a447e7903 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:51.833379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f1c39198-464b-40f9-9b9d-de6a447e7903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:51.912652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:51.985209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c39198-464b-40f9-9b9d-de6a447e7903 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:52.108383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e9aac-05bf-4a5f-9772-46d4943adab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:52.108997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e9aac-05bf-4a5f-9772-46d4943adab7 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:52.109268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e9aac-05bf-4a5f-9772-46d4943adab7 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:52.109562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e9aac-05bf-4a5f-9772-46d4943adab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:52.111176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a28e9aac-05bf-4a5f-9772-46d4943adab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:52.163065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:52.217135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e9aac-05bf-4a5f-9772-46d4943adab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:52.218843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e9aac-05bf-4a5f-9772-46d4943adab7 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:52.237925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 690/1388] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:54.317283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f97b20-0b87-4f04-836f-6ddfd2393244 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:54.317962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f97b20-0b87-4f04-836f-6ddfd2393244 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:54.317962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f97b20-0b87-4f04-836f-6ddfd2393244 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:54.319240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 699/1389] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:54.324630 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb1be-f5bf-4e90-9f5e-2ea53242f253 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:54.325039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb1be-f5bf-4e90-9f5e-2ea53242f253 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:54.325299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb1be-f5bf-4e90-9f5e-2ea53242f253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:54.391751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-fd8fb1be-f5bf-4e90-9f5e-2ea53242f253 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:54.392940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fd8fb1be-f5bf-4e90-9f5e-2ea53242f253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:54.488598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 691/1390] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:28:54.531906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f97b20-0b87-4f04-836f-6ddfd2393244 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:54.533501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c3f97b20-0b87-4f04-836f-6ddfd2393244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:54.684329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f97b20-0b87-4f04-836f-6ddfd2393244 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:54.701033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:54.801545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6cf69-eb7b-4a0d-863b-7f2393a9927e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:54.802065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6cf69-eb7b-4a0d-863b-7f2393a9927e service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:54.802342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6cf69-eb7b-4a0d-863b-7f2393a9927e service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:54.802612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6cf69-eb7b-4a0d-863b-7f2393a9927e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:54.804235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bff6cf69-eb7b-4a0d-863b-7f2393a9927e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:54.893440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6cf69-eb7b-4a0d-863b-7f2393a9927e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:54.895037 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6cf69-eb7b-4a0d-863b-7f2393a9927e service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:54.913550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 700/1391] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:55.639591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd851861-a19b-436e-9ebc-73294dcefbd2 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:55.640119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd851861-a19b-436e-9ebc-73294dcefbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:55.640119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd851861-a19b-436e-9ebc-73294dcefbd2 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:55.641658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 692/1392] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:55.646777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f4760-43bb-4142-990a-c964f22ed77c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:55.647209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f4760-43bb-4142-990a-c964f22ed77c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:55.647370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f4760-43bb-4142-990a-c964f22ed77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:55.673763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:55.714442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-411f4760-43bb-4142-990a-c964f22ed77c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:55.715664 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-411f4760-43bb-4142-990a-c964f22ed77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:55.812729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 701/1393] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:55.868250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93815805-5c3f-429f-a941-945a30877aa5 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:55.868536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93815805-5c3f-429f-a941-945a30877aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:55.868810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93815805-5c3f-429f-a941-945a30877aa5 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:55.870206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 693/1394] 10.222.0.69 () {54 vars in 966 bytes} [Thu Aug 4 02:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:28:55.875105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d424-e3f3-4f57-b1d8-9d6840dff283 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:55.875391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d424-e3f3-4f57-b1d8-9d6840dff283 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:55.875667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730d424-e3f3-4f57-b1d8-9d6840dff283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:55.950603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f730d424-e3f3-4f57-b1d8-9d6840dff283 None None] MFA Rules not processed for user `cc2ef9088a9941ddb4b163f282a1f7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:55.951802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f730d424-e3f3-4f57-b1d8-9d6840dff283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:55.991643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:56.028935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 702/1395] 10.222.0.69 () {58 vars in 1063 bytes} [Thu Aug 4 02:28:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:56.036696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93815805-5c3f-429f-a941-945a30877aa5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:56.038445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-93815805-5c3f-429f-a941-945a30877aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:56.052273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:56.145757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93815805-5c3f-429f-a941-945a30877aa5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:56.222666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b68b57-fd21-4df3-af83-04fd3996f476 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2ef9088a9941ddb4b163f282a1f7d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:56.223277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b68b57-fd21-4df3-af83-04fd3996f476 service glance] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:56.223552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b68b57-fd21-4df3-af83-04fd3996f476 service glance] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:56.223822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b68b57-fd21-4df3-af83-04fd3996f476 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:56.225437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-38b68b57-fd21-4df3-af83-04fd3996f476 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:56.294730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:56.338928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b68b57-fd21-4df3-af83-04fd3996f476 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:56.340365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b68b57-fd21-4df3-af83-04fd3996f476 service glance] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:56.358762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 694/1396] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:28:56.929200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69332c09-4a00-4aa5-9d4e-b9c3b3e584a6 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:56.929848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69332c09-4a00-4aa5-9d4e-b9c3b3e584a6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:56.930555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69332c09-4a00-4aa5-9d4e-b9c3b3e584a6 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:56.932089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 703/1397] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:56.937562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bda94c-3026-4186-a63c-805819c82fc7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:56.938041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bda94c-3026-4186-a63c-805819c82fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:56.938160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bda94c-3026-4186-a63c-805819c82fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:57.014078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-95bda94c-3026-4186-a63c-805819c82fc7 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:57.015265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-95bda94c-3026-4186-a63c-805819c82fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:57.105535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd264b8f-a90b-4e3c-87c6-9a7000f01960 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:57.105820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd264b8f-a90b-4e3c-87c6-9a7000f01960 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:57.106094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd264b8f-a90b-4e3c-87c6-9a7000f01960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:57.125963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 695/1398] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:57.170786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bda94c-3026-4186-a63c-805819c82fc7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:57.171993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-95bda94c-3026-4186-a63c-805819c82fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:57.174418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bd264b8f-a90b-4e3c-87c6-9a7000f01960 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:57.175587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bd264b8f-a90b-4e3c-87c6-9a7000f01960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:57.201493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:57.263532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 704/1399] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:28:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:28:57.290008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bda94c-3026-4186-a63c-805819c82fc7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:57.309016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65795-6eb5-49e1-aebe-8c45d12de890 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:57.309299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65795-6eb5-49e1-aebe-8c45d12de890 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:57.309595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65795-6eb5-49e1-aebe-8c45d12de890 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:57.311017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 705/1400] 10.222.0.69 () {54 vars in 943 bytes} [Thu Aug 4 02:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:28:57.316797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a85d-529b-47d7-86e3-176b01b9abb6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:57.317141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a85d-529b-47d7-86e3-176b01b9abb6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:57.317510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a85d-529b-47d7-86e3-176b01b9abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:57.386709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:57.396264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-de44a85d-529b-47d7-86e3-176b01b9abb6 None None] MFA Rules not processed for user `d7e996ea899e4bf8a65b721628a044ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:57.397515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-de44a85d-529b-47d7-86e3-176b01b9abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:57.408562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08321c5-01d7-4905-8705-2d964ff594b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:57.409169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08321c5-01d7-4905-8705-2d964ff594b9 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:57.409482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08321c5-01d7-4905-8705-2d964ff594b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:57.409756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08321c5-01d7-4905-8705-2d964ff594b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:57.411372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c08321c5-01d7-4905-8705-2d964ff594b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:57.429707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:57.501919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08321c5-01d7-4905-8705-2d964ff594b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:57.503435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08321c5-01d7-4905-8705-2d964ff594b9 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:57.503995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 706/1401] 10.222.0.69 () {58 vars in 1040 bytes} [Thu Aug 4 02:28:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:28:57.514149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a85d-529b-47d7-86e3-176b01b9abb6 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:57.522621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 696/1402] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:28:57.524599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a85d-529b-47d7-86e3-176b01b9abb6 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:28:57.652271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a182da-b510-493d-a983-227a5caa2734 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:28:57.652902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a182da-b510-493d-a983-227a5caa2734 service swift] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:57.653182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a182da-b510-493d-a983-227a5caa2734 service swift] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:57.653494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a182da-b510-493d-a983-227a5caa2734 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:57.655263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c2a182da-b510-493d-a983-227a5caa2734 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:57.658256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:57.746426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a182da-b510-493d-a983-227a5caa2734 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:28:57.748019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a182da-b510-493d-a983-227a5caa2734 service swift] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:28:57.756225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 707/1403] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:28:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 02:28:59.583464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc83e13-f899-4787-8135-ebe81fce98ed None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:59.583464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc83e13-f899-4787-8135-ebe81fce98ed None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:59.583464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc83e13-f899-4787-8135-ebe81fce98ed None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:59.583464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 697/1404] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:28:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:28:59.611145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02461909-845f-48b3-8c49-db9a0be61363 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:28:59.611145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02461909-845f-48b3-8c49-db9a0be61363 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:28:59.611145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02461909-845f-48b3-8c49-db9a0be61363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:28:59.681124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-02461909-845f-48b3-8c49-db9a0be61363 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:28:59.682452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-02461909-845f-48b3-8c49-db9a0be61363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:59.783415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:59.791483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 708/1405] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:28:59.835662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc83e13-f899-4787-8135-ebe81fce98ed None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:28:59.837173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-afc83e13-f899-4787-8135-ebe81fce98ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:28:59.993566 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:28:59.996713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc83e13-f899-4787-8135-ebe81fce98ed None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:00.122375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85afd5-7506-40e3-b360-c601eb1931ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:00.122375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85afd5-7506-40e3-b360-c601eb1931ab service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:00.122375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85afd5-7506-40e3-b360-c601eb1931ab service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:00.122375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85afd5-7506-40e3-b360-c601eb1931ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:00.122879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-df85afd5-7506-40e3-b360-c601eb1931ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:00.220596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85afd5-7506-40e3-b360-c601eb1931ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:00.222233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85afd5-7506-40e3-b360-c601eb1931ab service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:00.241705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 698/1406] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:02.313896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c268e2-4ff6-4cc0-8ffd-805da48de583 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:02.314441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c268e2-4ff6-4cc0-8ffd-805da48de583 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:02.314441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c268e2-4ff6-4cc0-8ffd-805da48de583 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:02.315812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 709/1407] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:02.321216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af71ce1-e7db-4551-b1be-2b45653f176a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:02.321700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af71ce1-e7db-4551-b1be-2b45653f176a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:02.321790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af71ce1-e7db-4551-b1be-2b45653f176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:02.327845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:02.422898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1af71ce1-e7db-4551-b1be-2b45653f176a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:02.424043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1af71ce1-e7db-4551-b1be-2b45653f176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:02.531443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 699/1408] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:02.579469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c268e2-4ff6-4cc0-8ffd-805da48de583 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:02.581292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b3c268e2-4ff6-4cc0-8ffd-805da48de583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:02.764322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c268e2-4ff6-4cc0-8ffd-805da48de583 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:02.838700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:02.887336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7bb5e-f2f1-42f3-9792-6e856b2aef9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:02.888262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7bb5e-f2f1-42f3-9792-6e856b2aef9b service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:02.888542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7bb5e-f2f1-42f3-9792-6e856b2aef9b service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:02.888810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7bb5e-f2f1-42f3-9792-6e856b2aef9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:02.890591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-45a7bb5e-f2f1-42f3-9792-6e856b2aef9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:02.985697 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7bb5e-f2f1-42f3-9792-6e856b2aef9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:02.987435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7bb5e-f2f1-42f3-9792-6e856b2aef9b service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:03.006862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 710/1409] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:12.529714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=64 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:13.007065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=64 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:20.036904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282303-90fb-4cce-9624-47cb684aa7c7 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:20.037508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282303-90fb-4cce-9624-47cb684aa7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:20.037508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43282303-90fb-4cce-9624-47cb684aa7c7 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:20.039399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 700/1410] 10.222.0.69 () {54 vars in 918 bytes} [Thu Aug 4 02:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:20.044494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabee00-3078-4978-a695-5dc1a7249742 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:20.044955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabee00-3078-4978-a695-5dc1a7249742 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:20.045066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabee00-3078-4978-a695-5dc1a7249742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:20.120087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-acabee00-3078-4978-a695-5dc1a7249742 None None] MFA Rules not processed for user `234cbff2a729458a8dad108baaba6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:20.121277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-acabee00-3078-4978-a695-5dc1a7249742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:20.224480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 711/1411] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Aug 4 02:29:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:20.239216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a7c53-4c0c-47f4-acd3-45686e98bd01 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:20.239501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a7c53-4c0c-47f4-acd3-45686e98bd01 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:20.239779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a7c53-4c0c-47f4-acd3-45686e98bd01 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:20.241133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 701/1412] 10.222.0.69 () {54 vars in 918 bytes} [Thu Aug 4 02:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:20.246358 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfaf52-45ab-4e67-955d-6c1216f9069c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:20.246646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfaf52-45ab-4e67-955d-6c1216f9069c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:20.246926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfaf52-45ab-4e67-955d-6c1216f9069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:20.319376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:20.322372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-00bfaf52-45ab-4e67-955d-6c1216f9069c None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:20.324145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-00bfaf52-45ab-4e67-955d-6c1216f9069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:20.437081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 712/1413] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Aug 4 02:29:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:22.872977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5f326-3ea3-428a-8e3f-bf95030cfaf2 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:22.873531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5f326-3ea3-428a-8e3f-bf95030cfaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:22.873531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5f326-3ea3-428a-8e3f-bf95030cfaf2 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:22.874880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:22.880098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f950-2a07-4995-9fc8-400cd007eea6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:22.880492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f950-2a07-4995-9fc8-400cd007eea6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:22.880684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f950-2a07-4995-9fc8-400cd007eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:22.946169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e880f950-2a07-4995-9fc8-400cd007eea6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:22.947366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e880f950-2a07-4995-9fc8-400cd007eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:23.000781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:23.042577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:23.085679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5f326-3ea3-428a-8e3f-bf95030cfaf2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:23.087201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c0b5f326-3ea3-428a-8e3f-bf95030cfaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:23.232218 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5f326-3ea3-428a-8e3f-bf95030cfaf2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:23.304864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:23.345524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04638716-795f-4690-bd11-556b14a7bb24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:23.346161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638716-795f-4690-bd11-556b14a7bb24 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:23.346442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638716-795f-4690-bd11-556b14a7bb24 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:23.346713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04638716-795f-4690-bd11-556b14a7bb24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:23.348323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-04638716-795f-4690-bd11-556b14a7bb24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:23.436798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04638716-795f-4690-bd11-556b14a7bb24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:23.438404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04638716-795f-4690-bd11-556b14a7bb24 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:23.457099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 703/1416] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:24.358472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233678f0-2913-4f45-8300-05e7b56c9df1 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:24.359021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233678f0-2913-4f45-8300-05e7b56c9df1 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:24.359021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233678f0-2913-4f45-8300-05e7b56c9df1 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:24.360374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:24.365173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e17e-6561-4bdd-a28c-88c46fe91e0f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:24.365674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e17e-6561-4bdd-a28c-88c46fe91e0f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:24.365786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e17e-6561-4bdd-a28c-88c46fe91e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:24.444842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5a24e17e-6561-4bdd-a28c-88c46fe91e0f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:24.446071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5a24e17e-6561-4bdd-a28c-88c46fe91e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:24.472692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:24.541550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:24.689257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233678f0-2913-4f45-8300-05e7b56c9df1 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:24.690796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-233678f0-2913-4f45-8300-05e7b56c9df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:24.840544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233678f0-2913-4f45-8300-05e7b56c9df1 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:24.879913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:24.953833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaca5de-cdef-43bb-8953-e93b31a04d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:24.954445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaca5de-cdef-43bb-8953-e93b31a04d85 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:24.954721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaca5de-cdef-43bb-8953-e93b31a04d85 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:24.954988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaca5de-cdef-43bb-8953-e93b31a04d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:24.956602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bdaca5de-cdef-43bb-8953-e93b31a04d85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:25.044959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaca5de-cdef-43bb-8953-e93b31a04d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:25.046582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaca5de-cdef-43bb-8953-e93b31a04d85 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:25.064549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 715/1419] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:25.938316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b803-0670-40af-be52-2b2174776ad2 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:25.938847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b803-0670-40af-be52-2b2174776ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:25.938847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2b803-0670-40af-be52-2b2174776ad2 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:25.940235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:29:25.945778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380d80c-e5f3-4363-a235-4169508a26f8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:25.946208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380d80c-e5f3-4363-a235-4169508a26f8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:25.946310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380d80c-e5f3-4363-a235-4169508a26f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:25.999535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:26.021868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b380d80c-e5f3-4363-a235-4169508a26f8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:26.023629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b380d80c-e5f3-4363-a235-4169508a26f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:26.117308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:26.266028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b803-0670-40af-be52-2b2174776ad2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:26.267700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-90a2b803-0670-40af-be52-2b2174776ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:26.414161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2b803-0670-40af-be52-2b2174776ad2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:26.425832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:26.526823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39915f44-df15-4adf-8c7b-1dd54b5b66dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:26.527363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39915f44-df15-4adf-8c7b-1dd54b5b66dd service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:26.527644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39915f44-df15-4adf-8c7b-1dd54b5b66dd service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:26.527914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39915f44-df15-4adf-8c7b-1dd54b5b66dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:26.529558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-39915f44-df15-4adf-8c7b-1dd54b5b66dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:26.618343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39915f44-df15-4adf-8c7b-1dd54b5b66dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:26.619936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39915f44-df15-4adf-8c7b-1dd54b5b66dd service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:26.637621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 706/1422] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:27.494497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb55f6-f3e1-43c0-b7a6-0d3a39dcbdb5 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:27.495084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb55f6-f3e1-43c0-b7a6-0d3a39dcbdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:27.495084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb55f6-f3e1-43c0-b7a6-0d3a39dcbdb5 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:27.496445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:27.501504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4cfe1-fcee-46ea-8cc6-5c08a9e2ce5f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:27.501894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4cfe1-fcee-46ea-8cc6-5c08a9e2ce5f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:27.502087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4cfe1-fcee-46ea-8cc6-5c08a9e2ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:27.523058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:27.579274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9bb4cfe1-fcee-46ea-8cc6-5c08a9e2ce5f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:27.580482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9bb4cfe1-fcee-46ea-8cc6-5c08a9e2ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:27.675592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:27.825836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb55f6-f3e1-43c0-b7a6-0d3a39dcbdb5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:27.827278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e1fb55f6-f3e1-43c0-b7a6-0d3a39dcbdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:27.937406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:27.973494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb55f6-f3e1-43c0-b7a6-0d3a39dcbdb5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:28.086217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdb530-dc46-4497-bec3-c9f061136f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:28.086733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdb530-dc46-4497-bec3-c9f061136f95 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:28.087008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdb530-dc46-4497-bec3-c9f061136f95 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:28.087277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdb530-dc46-4497-bec3-c9f061136f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:28.088895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a3fdb530-dc46-4497-bec3-c9f061136f95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:28.284277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:28.299900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdb530-dc46-4497-bec3-c9f061136f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:28.301517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdb530-dc46-4497-bec3-c9f061136f95 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:28.319799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 718/1425] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:29.167201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20279a1e-4c20-4bfb-bad6-1e521789d697 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:29.167751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20279a1e-4c20-4bfb-bad6-1e521789d697 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:29.167751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20279a1e-4c20-4bfb-bad6-1e521789d697 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:29.169142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:29.174097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1d247-0a9f-496d-af39-1c875a2266eb None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:29.174506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1d247-0a9f-496d-af39-1c875a2266eb None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:29.174650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1d247-0a9f-496d-af39-1c875a2266eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:29.249643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-1aa1d247-0a9f-496d-af39-1c875a2266eb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:29.250818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1aa1d247-0a9f-496d-af39-1c875a2266eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:29.344884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:29.493352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20279a1e-4c20-4bfb-bad6-1e521789d697 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:29.494865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-20279a1e-4c20-4bfb-bad6-1e521789d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:29.578614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:29.641440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20279a1e-4c20-4bfb-bad6-1e521789d697 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:29.753845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6575a25-1273-4d64-bc28-2573137a9c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:29.754366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575a25-1273-4d64-bc28-2573137a9c82 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:29.754643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575a25-1273-4d64-bc28-2573137a9c82 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:29.754915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575a25-1273-4d64-bc28-2573137a9c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:29.756539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f6575a25-1273-4d64-bc28-2573137a9c82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:29.805016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:29.846335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6575a25-1273-4d64-bc28-2573137a9c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:29.847938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6575a25-1273-4d64-bc28-2573137a9c82 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:29.866761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 709/1428] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:30.658455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ba1b1-a12e-40a3-a46a-d16a9cf5cf02 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:30.658981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ba1b1-a12e-40a3-a46a-d16a9cf5cf02 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:30.658981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ba1b1-a12e-40a3-a46a-d16a9cf5cf02 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:30.660352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:30.665263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce8d39-038a-49a0-97d1-b50fd41fd373 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:30.665702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce8d39-038a-49a0-97d1-b50fd41fd373 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:30.665842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce8d39-038a-49a0-97d1-b50fd41fd373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:30.738854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e0ce8d39-038a-49a0-97d1-b50fd41fd373 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:30.740045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e0ce8d39-038a-49a0-97d1-b50fd41fd373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:30.835134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:30.984721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ba1b1-a12e-40a3-a46a-d16a9cf5cf02 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:30.986295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c46ba1b1-a12e-40a3-a46a-d16a9cf5cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:31.035232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:31.130618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ba1b1-a12e-40a3-a46a-d16a9cf5cf02 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:31.241960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579202dd-792d-4421-8d5b-a484f20afe8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:31.242563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579202dd-792d-4421-8d5b-a484f20afe8b service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:31.242838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579202dd-792d-4421-8d5b-a484f20afe8b service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:31.243108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579202dd-792d-4421-8d5b-a484f20afe8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:31.244711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-579202dd-792d-4421-8d5b-a484f20afe8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:31.251409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:31.337640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579202dd-792d-4421-8d5b-a484f20afe8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:31.339257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579202dd-792d-4421-8d5b-a484f20afe8b service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:31.357614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 721/1431] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:32.155747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ac75-2fb0-41c1-9ee8-a9c8462cf684 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:32.156315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ac75-2fb0-41c1-9ee8-a9c8462cf684 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:32.156315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ac75-2fb0-41c1-9ee8-a9c8462cf684 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:32.157695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:32.162801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd47ed6-1b8d-4f43-a956-0d65f22c47ba None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:32.163221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd47ed6-1b8d-4f43-a956-0d65f22c47ba None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:32.163350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd47ed6-1b8d-4f43-a956-0d65f22c47ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:32.239097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3dd47ed6-1b8d-4f43-a956-0d65f22c47ba None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:32.240301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3dd47ed6-1b8d-4f43-a956-0d65f22c47ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:32.307749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:32.336616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:32.484804 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ac75-2fb0-41c1-9ee8-a9c8462cf684 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:32.486521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3d56ac75-2fb0-41c1-9ee8-a9c8462cf684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:32.503816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:32.632760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ac75-2fb0-41c1-9ee8-a9c8462cf684 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:32.718864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:32.744429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78f15f-7c50-43b7-826c-0fc456e0f732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:32.744973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78f15f-7c50-43b7-826c-0fc456e0f732 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:32.745250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78f15f-7c50-43b7-826c-0fc456e0f732 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:32.745548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78f15f-7c50-43b7-826c-0fc456e0f732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:32.747148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2e78f15f-7c50-43b7-826c-0fc456e0f732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:32.835559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78f15f-7c50-43b7-826c-0fc456e0f732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:32.837148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78f15f-7c50-43b7-826c-0fc456e0f732 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:32.854858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 712/1434] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:33.655683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e271a-cd4f-4d5b-bffc-cd6f2cd6b06d None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:33.656247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e271a-cd4f-4d5b-bffc-cd6f2cd6b06d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:33.656247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e271a-cd4f-4d5b-bffc-cd6f2cd6b06d None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:33.657640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:33.662529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7e4d9-1ffe-441a-8346-e213e287afad None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:33.662960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7e4d9-1ffe-441a-8346-e213e287afad None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:33.663103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7e4d9-1ffe-441a-8346-e213e287afad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:33.739429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-79b7e4d9-1ffe-441a-8346-e213e287afad None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:33.740643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-79b7e4d9-1ffe-441a-8346-e213e287afad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:33.782149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:33.837014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:33.986511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e271a-cd4f-4d5b-bffc-cd6f2cd6b06d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:33.988023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ba6e271a-cd4f-4d5b-bffc-cd6f2cd6b06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:34.129587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e271a-cd4f-4d5b-bffc-cd6f2cd6b06d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:34.183426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:34.242404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d149df3-f866-46d7-9407-9ee28a3892e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:34.243007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d149df3-f866-46d7-9407-9ee28a3892e7 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:34.243280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d149df3-f866-46d7-9407-9ee28a3892e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:34.243543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d149df3-f866-46d7-9407-9ee28a3892e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:34.245130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2d149df3-f866-46d7-9407-9ee28a3892e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:34.336574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d149df3-f866-46d7-9407-9ee28a3892e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:34.338198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d149df3-f866-46d7-9407-9ee28a3892e7 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:34.355998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 724/1437] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:35.170936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba28d0-1390-4a9e-a5a1-cc7a84cbffe2 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:35.171533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba28d0-1390-4a9e-a5a1-cc7a84cbffe2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:35.171533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba28d0-1390-4a9e-a5a1-cc7a84cbffe2 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:35.172838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:35.177635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42735d1b-8145-47a3-a94a-64d884bb71c4 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:35.178023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42735d1b-8145-47a3-a94a-64d884bb71c4 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:35.178237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42735d1b-8145-47a3-a94a-64d884bb71c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:35.251896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-42735d1b-8145-47a3-a94a-64d884bb71c4 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:35.253076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-42735d1b-8145-47a3-a94a-64d884bb71c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:35.255056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:35.350749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:35.502428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba28d0-1390-4a9e-a5a1-cc7a84cbffe2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:35.503930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-85ba28d0-1390-4a9e-a5a1-cc7a84cbffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:35.649283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba28d0-1390-4a9e-a5a1-cc7a84cbffe2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:35.675158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:35.761115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce898a-3614-4767-9ba5-91a527b84161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:35.761675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce898a-3614-4767-9ba5-91a527b84161 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:35.761951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce898a-3614-4767-9ba5-91a527b84161 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:35.762218 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce898a-3614-4767-9ba5-91a527b84161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:35.763824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-50ce898a-3614-4767-9ba5-91a527b84161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:35.852043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce898a-3614-4767-9ba5-91a527b84161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:35.853687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce898a-3614-4767-9ba5-91a527b84161 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:35.872006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 715/1440] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:37.748508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb464e8-2866-46c5-88b0-d6e64978a7c2 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:37.752623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb464e8-2866-46c5-88b0-d6e64978a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:37.752924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb464e8-2866-46c5-88b0-d6e64978a7c2 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:37.754804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:37.760325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee2a8-7e83-4aa9-a512-a6471ac9dec0 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:37.760782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee2a8-7e83-4aa9-a512-a6471ac9dec0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:37.760886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee2a8-7e83-4aa9-a512-a6471ac9dec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:37.802730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:37.827381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c05ee2a8-7e83-4aa9-a512-a6471ac9dec0 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:37.828569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c05ee2a8-7e83-4aa9-a512-a6471ac9dec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:37.926398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:37.964956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb464e8-2866-46c5-88b0-d6e64978a7c2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:37.966579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4eb464e8-2866-46c5-88b0-d6e64978a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:38.067635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb464e8-2866-46c5-88b0-d6e64978a7c2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:38.099760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:38.140061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ff961-a04e-467d-86fe-8398e36533de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:38.140667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ff961-a04e-467d-86fe-8398e36533de service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:38.140944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ff961-a04e-467d-86fe-8398e36533de service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:38.141214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ff961-a04e-467d-86fe-8398e36533de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:38.142856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a58ff961-a04e-467d-86fe-8398e36533de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:38.251498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ff961-a04e-467d-86fe-8398e36533de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:38.252911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ff961-a04e-467d-86fe-8398e36533de service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:38.270545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 727/1443] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:40.416510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6b37-78b3-4587-9ca7-55de0224d758 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:40.417064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6b37-78b3-4587-9ca7-55de0224d758 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:40.417064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6b37-78b3-4587-9ca7-55de0224d758 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:40.418463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:40.424600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf75c-4243-47dd-8a19-fd2166c340b7 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:40.425138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf75c-4243-47dd-8a19-fd2166c340b7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:40.425138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbf75c-4243-47dd-8a19-fd2166c340b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:40.491133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-48cbf75c-4243-47dd-8a19-fd2166c340b7 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:40.492325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-48cbf75c-4243-47dd-8a19-fd2166c340b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:40.505399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:40.591311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:40.629202 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6b37-78b3-4587-9ca7-55de0224d758 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:40.630847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b11a6b37-78b3-4587-9ca7-55de0224d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:40.733253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6b37-78b3-4587-9ca7-55de0224d758 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:40.745675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:40.807041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ae5bf-9784-478d-9ef1-e4d3f1b3adef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:40.807647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ae5bf-9784-478d-9ef1-e4d3f1b3adef service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:40.807924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ae5bf-9784-478d-9ef1-e4d3f1b3adef service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:40.808195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ae5bf-9784-478d-9ef1-e4d3f1b3adef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:40.809822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ac6ae5bf-9784-478d-9ef1-e4d3f1b3adef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:40.917650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ae5bf-9784-478d-9ef1-e4d3f1b3adef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:40.919074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ae5bf-9784-478d-9ef1-e4d3f1b3adef service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:40.937435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 718/1446] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:43.247005 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66552e0-7f5f-4a26-8012-7c9f79ed0ca2 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:43.247569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66552e0-7f5f-4a26-8012-7c9f79ed0ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:43.247569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66552e0-7f5f-4a26-8012-7c9f79ed0ca2 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:43.248904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:43.254351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559159d-55c7-4891-b10b-cee9067f8a2a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:43.254777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559159d-55c7-4891-b10b-cee9067f8a2a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:43.254906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559159d-55c7-4891-b10b-cee9067f8a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:43.306215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:43.324129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8559159d-55c7-4891-b10b-cee9067f8a2a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:43.325360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8559159d-55c7-4891-b10b-cee9067f8a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:43.421459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:43.460782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66552e0-7f5f-4a26-8012-7c9f79ed0ca2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:43.462356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e66552e0-7f5f-4a26-8012-7c9f79ed0ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:43.563973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66552e0-7f5f-4a26-8012-7c9f79ed0ca2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:43.605423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:43.638973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2195e8-2701-4ba1-a356-5e6e4ed7f2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:43.639590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2195e8-2701-4ba1-a356-5e6e4ed7f2fc service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:43.639867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2195e8-2701-4ba1-a356-5e6e4ed7f2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:43.640141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2195e8-2701-4ba1-a356-5e6e4ed7f2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:43.641801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ba2195e8-2701-4ba1-a356-5e6e4ed7f2fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:43.754280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2195e8-2701-4ba1-a356-5e6e4ed7f2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:43.755691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2195e8-2701-4ba1-a356-5e6e4ed7f2fc service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:43.781740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 730/1449] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:45.873631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd231e-cf6b-4811-8a8c-7fc7381ca2f5 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:45.874166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd231e-cf6b-4811-8a8c-7fc7381ca2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:45.874166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd231e-cf6b-4811-8a8c-7fc7381ca2f5 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:45.875457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:45.880686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8952-0be7-4264-8942-82c406886560 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:45.881765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8952-0be7-4264-8942-82c406886560 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:45.881874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8952-0be7-4264-8942-82c406886560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:45.946368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-573c8952-0be7-4264-8942-82c406886560 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:45.947563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-573c8952-0be7-4264-8942-82c406886560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:45.967842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:46.043519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:46.082875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd231e-cf6b-4811-8a8c-7fc7381ca2f5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:46.084476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5dfd231e-cf6b-4811-8a8c-7fc7381ca2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:46.186638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd231e-cf6b-4811-8a8c-7fc7381ca2f5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:46.206634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:46.260828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f540598-8f39-4ae7-a855-d24177a16851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:46.261468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f540598-8f39-4ae7-a855-d24177a16851 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:46.261747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f540598-8f39-4ae7-a855-d24177a16851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:46.262015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f540598-8f39-4ae7-a855-d24177a16851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:46.263620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3f540598-8f39-4ae7-a855-d24177a16851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:46.371852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f540598-8f39-4ae7-a855-d24177a16851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:46.373269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f540598-8f39-4ae7-a855-d24177a16851 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:46.391401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 721/1452] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:48.437611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79096c4c-49da-4b8b-b4ab-c273bbf0e284 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:48.438210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79096c4c-49da-4b8b-b4ab-c273bbf0e284 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:48.438210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79096c4c-49da-4b8b-b4ab-c273bbf0e284 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:48.439518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:48.445302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530445e-1b88-4c70-97fa-5c76e8a2f104 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:48.445843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530445e-1b88-4c70-97fa-5c76e8a2f104 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:48.445934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530445e-1b88-4c70-97fa-5c76e8a2f104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:48.508398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:48.511174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4530445e-1b88-4c70-97fa-5c76e8a2f104 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:48.513063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4530445e-1b88-4c70-97fa-5c76e8a2f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:48.609340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:48.647249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79096c4c-49da-4b8b-b4ab-c273bbf0e284 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:48.648765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-79096c4c-49da-4b8b-b4ab-c273bbf0e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:48.751929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79096c4c-49da-4b8b-b4ab-c273bbf0e284 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:48.800128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:48.824804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769bcd-92d8-46ea-a769-2a2824754cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:48.825442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769bcd-92d8-46ea-a769-2a2824754cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:48.825723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769bcd-92d8-46ea-a769-2a2824754cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:48.825995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769bcd-92d8-46ea-a769-2a2824754cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:48.827602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c1769bcd-92d8-46ea-a769-2a2824754cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:48.933827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769bcd-92d8-46ea-a769-2a2824754cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:48.935236 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769bcd-92d8-46ea-a769-2a2824754cb7 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:48.952819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 733/1455] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:50.988806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d70ef1-7ea8-493d-87f5-2dfbb5adf62d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:50.989403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d70ef1-7ea8-493d-87f5-2dfbb5adf62d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:50.989403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d70ef1-7ea8-493d-87f5-2dfbb5adf62d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:50.991310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:50.996791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a445-fa40-4472-a4ae-f150cda42c2c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:50.997221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a445-fa40-4472-a4ae-f150cda42c2c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:50.997367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a445-fa40-4472-a4ae-f150cda42c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:51.063360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4ca6a445-fa40-4472-a4ae-f150cda42c2c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:51.064549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4ca6a445-fa40-4472-a4ae-f150cda42c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:51.093212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:51.160941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:51.199425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d70ef1-7ea8-493d-87f5-2dfbb5adf62d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:51.200972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-86d70ef1-7ea8-493d-87f5-2dfbb5adf62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:51.306582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d70ef1-7ea8-493d-87f5-2dfbb5adf62d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:51.335106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:51.379863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47471627-d784-4eeb-acb1-2cecaab5899b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:51.380475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47471627-d784-4eeb-acb1-2cecaab5899b service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:51.380773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47471627-d784-4eeb-acb1-2cecaab5899b service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:51.381043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47471627-d784-4eeb-acb1-2cecaab5899b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:51.382665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-47471627-d784-4eeb-acb1-2cecaab5899b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:51.488010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47471627-d784-4eeb-acb1-2cecaab5899b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:51.489440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47471627-d784-4eeb-acb1-2cecaab5899b service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:51.507456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 724/1458] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:53.534402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd85cf-caf8-4ec0-a2e7-d288248bd93c None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:53.534951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd85cf-caf8-4ec0-a2e7-d288248bd93c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:53.534951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd85cf-caf8-4ec0-a2e7-d288248bd93c None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:53.536296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:53.542206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d68a81-d946-4800-955d-c43d6b5edee8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:53.542614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d68a81-d946-4800-955d-c43d6b5edee8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:53.542771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d68a81-d946-4800-955d-c43d6b5edee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:53.609743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-17d68a81-d946-4800-955d-c43d6b5edee8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:53.610877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-17d68a81-d946-4800-955d-c43d6b5edee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:53.620111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:53.710702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:29:53.747814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd85cf-caf8-4ec0-a2e7-d288248bd93c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:53.749338 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fabd85cf-caf8-4ec0-a2e7-d288248bd93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:53.862941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd85cf-caf8-4ec0-a2e7-d288248bd93c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:53.917646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:53.935710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc2595-52ae-413c-99d5-dd7a27c1d286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:53.936319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc2595-52ae-413c-99d5-dd7a27c1d286 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:53.936598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc2595-52ae-413c-99d5-dd7a27c1d286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:53.936869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc2595-52ae-413c-99d5-dd7a27c1d286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:53.938588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9ecc2595-52ae-413c-99d5-dd7a27c1d286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:54.045314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc2595-52ae-413c-99d5-dd7a27c1d286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:54.046760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc2595-52ae-413c-99d5-dd7a27c1d286 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:54.064824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 736/1461] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:56.186417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25928f16-689e-412c-adc8-860148039225 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:56.186953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25928f16-689e-412c-adc8-860148039225 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:56.186953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25928f16-689e-412c-adc8-860148039225 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:56.188311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:56.193645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7f80b-fd40-43d4-8543-0203c5814dd9 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:56.194064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7f80b-fd40-43d4-8543-0203c5814dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:56.194178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7f80b-fd40-43d4-8543-0203c5814dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:56.258553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-61d7f80b-fd40-43d4-8543-0203c5814dd9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:56.259748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-61d7f80b-fd40-43d4-8543-0203c5814dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:56.297181 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:56.356790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:29:56.393032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25928f16-689e-412c-adc8-860148039225 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:56.394828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-25928f16-689e-412c-adc8-860148039225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:56.497896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25928f16-689e-412c-adc8-860148039225 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:56.535407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:56.571660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ad7be-31b4-4598-9821-0afa18052107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:56.572269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad7be-31b4-4598-9821-0afa18052107 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:56.572544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad7be-31b4-4598-9821-0afa18052107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:56.572811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ad7be-31b4-4598-9821-0afa18052107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:56.574557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d23ad7be-31b4-4598-9821-0afa18052107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:56.682135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ad7be-31b4-4598-9821-0afa18052107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:56.683597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ad7be-31b4-4598-9821-0afa18052107 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:56.701424 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 727/1464] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:29:58.697141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e387d-63d2-4b71-8f0a-efe7092848e9 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:58.697716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e387d-63d2-4b71-8f0a-efe7092848e9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:58.697837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e387d-63d2-4b71-8f0a-efe7092848e9 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:58.699110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:29:58.704292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769df4-894b-42ba-9c31-e4e23af9703e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:58.704701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769df4-894b-42ba-9c31-e4e23af9703e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:58.704866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d769df4-894b-42ba-9c31-e4e23af9703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:58.770866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4d769df4-894b-42ba-9c31-e4e23af9703e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:29:58.772590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4d769df4-894b-42ba-9c31-e4e23af9703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:58.791028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:58.869548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:29:58.905988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e387d-63d2-4b71-8f0a-efe7092848e9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:29:58.907523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-575e387d-63d2-4b71-8f0a-efe7092848e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:59.008555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e387d-63d2-4b71-8f0a-efe7092848e9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:29:59.073716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:29:59.081313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412596e-9cd0-4d0d-8489-667ad91754f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:29:59.081941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412596e-9cd0-4d0d-8489-667ad91754f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:29:59.082215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412596e-9cd0-4d0d-8489-667ad91754f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:29:59.082483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412596e-9cd0-4d0d-8489-667ad91754f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:29:59.084694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6412596e-9cd0-4d0d-8489-667ad91754f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:29:59.189685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412596e-9cd0-4d0d-8489-667ad91754f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:29:59.191097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412596e-9cd0-4d0d-8489-667ad91754f2 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:29:59.209779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 739/1467] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:01.200505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ac3fd-15dc-4d1c-bb97-ba49e86f8564 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:01.201046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ac3fd-15dc-4d1c-bb97-ba49e86f8564 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:01.201046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ac3fd-15dc-4d1c-bb97-ba49e86f8564 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:01.202442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:01.207770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f7ef4-ba0d-4e47-bbd3-6b11da41d7d5 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:01.208186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f7ef4-ba0d-4e47-bbd3-6b11da41d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:01.208943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f7ef4-ba0d-4e47-bbd3-6b11da41d7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:01.274066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e62f7ef4-ba0d-4e47-bbd3-6b11da41d7d5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:01.275290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e62f7ef4-ba0d-4e47-bbd3-6b11da41d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:01.323270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:01.373821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:01.410888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ac3fd-15dc-4d1c-bb97-ba49e86f8564 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:01.412497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-656ac3fd-15dc-4d1c-bb97-ba49e86f8564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:01.513820 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ac3fd-15dc-4d1c-bb97-ba49e86f8564 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:01.562359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:01.589557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e21197-b5f9-43ad-95d5-3395f948f460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:01.590170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e21197-b5f9-43ad-95d5-3395f948f460 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:01.590449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e21197-b5f9-43ad-95d5-3395f948f460 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:01.590723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e21197-b5f9-43ad-95d5-3395f948f460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:01.592342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-10e21197-b5f9-43ad-95d5-3395f948f460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:01.699997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e21197-b5f9-43ad-95d5-3395f948f460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:01.701441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e21197-b5f9-43ad-95d5-3395f948f460 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:01.719055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 730/1470] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:11.371940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=22 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:11.716803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=66 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:21.023162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef4e5-6142-43a2-af12-98c1dfac6260 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:21.023717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef4e5-6142-43a2-af12-98c1dfac6260 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:21.023717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef4e5-6142-43a2-af12-98c1dfac6260 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:21.025084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 741/1471] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:21.030312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a0aa-c65d-4b7a-8d18-3719c701023d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:21.030781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a0aa-c65d-4b7a-8d18-3719c701023d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:21.030884 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a0aa-c65d-4b7a-8d18-3719c701023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:21.095666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5e63a0aa-c65d-4b7a-8d18-3719c701023d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:21.096865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5e63a0aa-c65d-4b7a-8d18-3719c701023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:21.195330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 731/1472] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:21.277938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284702f-aaef-41b6-94b4-bb6cee8418e3 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:21.278168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284702f-aaef-41b6-94b4-bb6cee8418e3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:21.278439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284702f-aaef-41b6-94b4-bb6cee8418e3 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:21.279815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 742/1473] 10.222.0.69 () {54 vars in 966 bytes} [Thu Aug 4 02:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:21.284586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022cc3b-31a0-48ee-96e8-a00d78bc5985 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:21.284874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022cc3b-31a0-48ee-96e8-a00d78bc5985 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:21.285145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022cc3b-31a0-48ee-96e8-a00d78bc5985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:21.361095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b022cc3b-31a0-48ee-96e8-a00d78bc5985 None None] MFA Rules not processed for user `cc2ef9088a9941ddb4b163f282a1f7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:21.362346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b022cc3b-31a0-48ee-96e8-a00d78bc5985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:21.383668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:21.439463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 732/1474] 10.222.0.69 () {58 vars in 1063 bytes} [Thu Aug 4 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:21.447142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284702f-aaef-41b6-94b4-bb6cee8418e3 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:21.448712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f284702f-aaef-41b6-94b4-bb6cee8418e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:21.552685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284702f-aaef-41b6-94b4-bb6cee8418e3 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:21.627054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5df56-d36a-49a2-bde4-90d4efbf9ccf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2ef9088a9941ddb4b163f282a1f7d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:21.627673 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5df56-d36a-49a2-bde4-90d4efbf9ccf service glance] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:21.627952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5df56-d36a-49a2-bde4-90d4efbf9ccf service glance] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:21.628222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5df56-d36a-49a2-bde4-90d4efbf9ccf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:21.629876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-91f5df56-d36a-49a2-bde4-90d4efbf9ccf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:21.684143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:21.737841 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5df56-d36a-49a2-bde4-90d4efbf9ccf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:21.739862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5df56-d36a-49a2-bde4-90d4efbf9ccf service glance] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:21.758096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 743/1475] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:23.843581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264aa24-bcec-425a-86c0-7c3534026e7b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:23.844107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264aa24-bcec-425a-86c0-7c3534026e7b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:23.844107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264aa24-bcec-425a-86c0-7c3534026e7b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:23.845562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 733/1476] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:23.851166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61929c4f-eb0c-4ff7-a470-f95973b45b0f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:23.851611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61929c4f-eb0c-4ff7-a470-f95973b45b0f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:23.851735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61929c4f-eb0c-4ff7-a470-f95973b45b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:23.918719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-61929c4f-eb0c-4ff7-a470-f95973b45b0f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:23.919923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-61929c4f-eb0c-4ff7-a470-f95973b45b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:24.020292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 744/1477] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:24.043711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264aa24-bcec-425a-86c0-7c3534026e7b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:24.045248 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f264aa24-bcec-425a-86c0-7c3534026e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:24.169914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264aa24-bcec-425a-86c0-7c3534026e7b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:24.217634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:24.261920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8463c-41d3-4c7b-bae7-76a50e640962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:24.262523 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8463c-41d3-4c7b-bae7-76a50e640962 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:24.262795 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8463c-41d3-4c7b-bae7-76a50e640962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:24.263061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8463c-41d3-4c7b-bae7-76a50e640962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:24.263738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8463c-41d3-4c7b-bae7-76a50e640962 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:24.265544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-cbc8463c-41d3-4c7b-bae7-76a50e640962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:30:24.265544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: warnings.warn(msg) Aug 04 02:30:24.265544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: Aug 04 02:30:24.266683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8463c-41d3-4c7b-bae7-76a50e640962 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:24.286826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 734/1478] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Aug 4 02:30:24 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:30:26.313659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40f12-c7ed-4936-b03b-1faa9dba9812 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:26.314202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40f12-c7ed-4936-b03b-1faa9dba9812 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:26.314202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40f12-c7ed-4936-b03b-1faa9dba9812 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:26.315585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 745/1479] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:26.320999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d95e10-701a-43fc-94f9-b12f2b7bf531 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:26.321476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d95e10-701a-43fc-94f9-b12f2b7bf531 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:26.321585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d95e10-701a-43fc-94f9-b12f2b7bf531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:26.387609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-04d95e10-701a-43fc-94f9-b12f2b7bf531 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:26.388819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-04d95e10-701a-43fc-94f9-b12f2b7bf531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:26.483685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 735/1480] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:26.526782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40f12-c7ed-4936-b03b-1faa9dba9812 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:26.528292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2ab40f12-c7ed-4936-b03b-1faa9dba9812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:26.538269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:26.677801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40f12-c7ed-4936-b03b-1faa9dba9812 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:26.756107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:26.788837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7312717-c66f-4aea-89db-e003538ec881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:26.789480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7312717-c66f-4aea-89db-e003538ec881 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:26.789762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7312717-c66f-4aea-89db-e003538ec881 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:26.790034 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7312717-c66f-4aea-89db-e003538ec881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:26.791653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e7312717-c66f-4aea-89db-e003538ec881 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:26.879725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7312717-c66f-4aea-89db-e003538ec881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:26.881300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7312717-c66f-4aea-89db-e003538ec881 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:26.899403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 746/1481] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:29.077291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa89360-e0c3-4bba-b368-a83399487306 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:29.077971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa89360-e0c3-4bba-b368-a83399487306 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:29.077971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa89360-e0c3-4bba-b368-a83399487306 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:29.079221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 736/1482] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:29.085037 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7abb4e-624c-4ed7-b895-ac2b88ec69dd None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:29.085465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7abb4e-624c-4ed7-b895-ac2b88ec69dd None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:29.085615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7abb4e-624c-4ed7-b895-ac2b88ec69dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:29.153800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ae7abb4e-624c-4ed7-b895-ac2b88ec69dd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:29.154995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ae7abb4e-624c-4ed7-b895-ac2b88ec69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:29.202525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:29.254966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 747/1483] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:29.291686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa89360-e0c3-4bba-b368-a83399487306 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:29.293153 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cfa89360-e0c3-4bba-b368-a83399487306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:29.318851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:29.522679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa89360-e0c3-4bba-b368-a83399487306 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:29.601350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcda9e0-ee8b-4db1-9643-dde99e9831f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:29.601985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcda9e0-ee8b-4db1-9643-dde99e9831f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:29.602258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcda9e0-ee8b-4db1-9643-dde99e9831f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:29.602523 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcda9e0-ee8b-4db1-9643-dde99e9831f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:29.604128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cdcda9e0-ee8b-4db1-9643-dde99e9831f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:29.681442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:29.717681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcda9e0-ee8b-4db1-9643-dde99e9831f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:29.719129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcda9e0-ee8b-4db1-9643-dde99e9831f3 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:29.738126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 737/1484] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:31.818791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9644-2bf6-4f97-a368-1a6faeaf7145 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:31.819334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9644-2bf6-4f97-a368-1a6faeaf7145 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:31.819334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9644-2bf6-4f97-a368-1a6faeaf7145 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:31.820722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 748/1485] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:31.826252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75ba7-21cf-486a-8b45-60dcf01bc287 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:31.826674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75ba7-21cf-486a-8b45-60dcf01bc287 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:31.826777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75ba7-21cf-486a-8b45-60dcf01bc287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:31.893908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-94f75ba7-21cf-486a-8b45-60dcf01bc287 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:31.895651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-94f75ba7-21cf-486a-8b45-60dcf01bc287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:32.003126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 738/1486] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:32.043453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f9644-2bf6-4f97-a368-1a6faeaf7145 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:32.045008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-259f9644-2bf6-4f97-a368-1a6faeaf7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:32.153967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f9644-2bf6-4f97-a368-1a6faeaf7145 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:32.232818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:32.234754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b71fe-ba88-4e36-acc6-08949eba50a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:32.235409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b71fe-ba88-4e36-acc6-08949eba50a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:32.235884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b71fe-ba88-4e36-acc6-08949eba50a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:32.236159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b71fe-ba88-4e36-acc6-08949eba50a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:32.239066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4d8b71fe-ba88-4e36-acc6-08949eba50a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:32.353039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b71fe-ba88-4e36-acc6-08949eba50a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:32.354518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b71fe-ba88-4e36-acc6-08949eba50a7 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:32.372979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 749/1487] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:34.589524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9324-fd56-4d66-ac08-1f0d3fc37085 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:34.590054 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9324-fd56-4d66-ac08-1f0d3fc37085 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:34.590164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb9324-fd56-4d66-ac08-1f0d3fc37085 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:34.591444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 739/1488] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:30:34.596783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07ec4-660c-41eb-8fbf-ce5fd1c39a60 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:34.597205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07ec4-660c-41eb-8fbf-ce5fd1c39a60 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:34.597351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07ec4-660c-41eb-8fbf-ce5fd1c39a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:34.666178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-63f07ec4-660c-41eb-8fbf-ce5fd1c39a60 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:34.667627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-63f07ec4-660c-41eb-8fbf-ce5fd1c39a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:34.721310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:34.765557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 750/1489] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:34.806827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb9324-fd56-4d66-ac08-1f0d3fc37085 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:34.808385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-efcb9324-fd56-4d66-ac08-1f0d3fc37085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:34.848917 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:34.918023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb9324-fd56-4d66-ac08-1f0d3fc37085 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:34.995977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f355-c56b-4afb-94d3-169b68244635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:34.996591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f355-c56b-4afb-94d3-169b68244635 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:34.996867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f355-c56b-4afb-94d3-169b68244635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:34.997135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f355-c56b-4afb-94d3-169b68244635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:34.998843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6022f355-c56b-4afb-94d3-169b68244635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:35.076967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:35.107565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f355-c56b-4afb-94d3-169b68244635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:35.109064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f355-c56b-4afb-94d3-169b68244635 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:35.128185 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 740/1490] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:37.347024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d701a92-e6b2-4cf4-897b-3ea9c76736e0 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:37.348047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d701a92-e6b2-4cf4-897b-3ea9c76736e0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:37.348158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d701a92-e6b2-4cf4-897b-3ea9c76736e0 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:37.349486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 751/1491] 10.222.0.69 () {54 vars in 927 bytes} [Thu Aug 4 02:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:30:37.354727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52148-98ea-44cf-b7b6-cd8359f1b4d1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:37.355149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52148-98ea-44cf-b7b6-cd8359f1b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:37.355260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52148-98ea-44cf-b7b6-cd8359f1b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:37.419656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3fb52148-98ea-44cf-b7b6-cd8359f1b4d1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:30:37.420843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3fb52148-98ea-44cf-b7b6-cd8359f1b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:37.514560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 741/1492] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Aug 4 02:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:30:37.554396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d701a92-e6b2-4cf4-897b-3ea9c76736e0 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:30:37.555984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6d701a92-e6b2-4cf4-897b-3ea9c76736e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:37.657871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d701a92-e6b2-4cf4-897b-3ea9c76736e0 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:30:37.729993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4646d-fb82-43f4-8b7e-7183156aa553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:30:37.730613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4646d-fb82-43f4-8b7e-7183156aa553 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:30:37.730896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4646d-fb82-43f4-8b7e-7183156aa553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:30:37.731269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4646d-fb82-43f4-8b7e-7183156aa553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:30:37.732909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1cd4646d-fb82-43f4-8b7e-7183156aa553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:30:37.742961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:37.844234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4646d-fb82-43f4-8b7e-7183156aa553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:30:37.845706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4646d-fb82-43f4-8b7e-7183156aa553 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:30:37.864054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 752/1493] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:30:47.512716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=82 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:30:47.861863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=50 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:14.362111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4504f7-6ccd-4a87-8701-987389ac73da None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:14.362679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4504f7-6ccd-4a87-8701-987389ac73da None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:14.362679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4504f7-6ccd-4a87-8701-987389ac73da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:14.437182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8b4504f7-6ccd-4a87-8701-987389ac73da None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:14.438392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8b4504f7-6ccd-4a87-8701-987389ac73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:14.532041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 742/1494] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:14.540660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abab68-4f1b-4baa-b5a9-2543952c6740 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:14.541139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abab68-4f1b-4baa-b5a9-2543952c6740 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:14.541254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abab68-4f1b-4baa-b5a9-2543952c6740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:14.616974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-35abab68-4f1b-4baa-b5a9-2543952c6740 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:14.618217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-35abab68-4f1b-4baa-b5a9-2543952c6740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:14.712593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 753/1495] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:14.717231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4504f7-6ccd-4a87-8701-987389ac73da None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:14.718438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8b4504f7-6ccd-4a87-8701-987389ac73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:14.730285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4504f7-6ccd-4a87-8701-987389ac73da None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:14.790527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:14.823128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:14.823725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:14.823998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:14.824264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:14.824934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:32:14.825224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:14.826256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:14.826256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: warnings.warn(msg) Aug 04 02:32:14.826256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: Aug 04 02:32:14.827115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:14.838568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 743/1496] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:32:14.847511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abab68-4f1b-4baa-b5a9-2543952c6740 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:14.856523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abab68-4f1b-4baa-b5a9-2543952c6740 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:14.916866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:14.949516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:14.950119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:14.950391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:14.950658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:14.951305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:14.952999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WARNING py.warnings [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:14.952999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: warnings.warn(msg) Aug 04 02:32:14.952999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: Aug 04 02:32:14.954716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:15.009296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 754/1497] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:32:14 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:32:15.013635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:15.015436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:15.048654 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2515-f951-42f8-8858-b60c2862eca2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:15.139351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:15.140211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:15.140486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:15.140755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:15.141442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:15.143049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:15.143049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: warnings.warn(msg) Aug 04 02:32:15.143049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: Aug 04 02:32:15.144243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:15.184795 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 744/1498] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:32:15 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:32:15.189357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:15.190834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:15.252802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dda37-a1c6-4a17-a9f0-b1b97c166384 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:15.336963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:15.347791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:15.348397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:15.348671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:15.348938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:15.349644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:15.350629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WARNING py.warnings [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:15.350629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: warnings.warn(msg) Aug 04 02:32:15.350629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: Aug 04 02:32:15.351499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:15.363498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 755/1499] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:32:15.367552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:15.369105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:15.380911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e07d85-bc47-402a-9735-21d22a07c5fc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:15.406456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:15.475607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b732f6-f400-4723-b035-f2cfbc4ec8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:15.476281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b732f6-f400-4723-b035-f2cfbc4ec8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:15.476559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b732f6-f400-4723-b035-f2cfbc4ec8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:15.476830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b732f6-f400-4723-b035-f2cfbc4ec8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:15.477549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b732f6-f400-4723-b035-f2cfbc4ec8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:15.478559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-e6b732f6-f400-4723-b035-f2cfbc4ec8a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:15.478559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: warnings.warn(msg) Aug 04 02:32:15.478559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: Aug 04 02:32:15.479432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b732f6-f400-4723-b035-f2cfbc4ec8a7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:15.492007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 745/1500] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:32:15.496287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:15.497833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:15.531432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f12605-4f8c-4e21-8485-edb672309d59 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:15.624359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb289-a2d0-4317-9af1-5b340ea1ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:15.624969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb289-a2d0-4317-9af1-5b340ea1ce79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:15.625231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb289-a2d0-4317-9af1-5b340ea1ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:15.625540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb289-a2d0-4317-9af1-5b340ea1ce79 admin admin] PATH_INFO: `/v3/projects/88c252b5de0541ad982c3e19daa2ac0c/users/d7bba95372f14b159c9ec4212b8e38fe/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:15.647861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb289-a2d0-4317-9af1-5b340ea1ce79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c252b5de0541ad982c3e19daa2ac0c, user_id=d7bba95372f14b159c9ec4212b8e38fe, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:15.648883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WARNING py.warnings [None req-f5ceb289-a2d0-4317-9af1-5b340ea1ce79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:15.648883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: warnings.warn(msg) Aug 04 02:32:15.648883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: Aug 04 02:32:15.650847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb289-a2d0-4317-9af1-5b340ea1ce79 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:15.674800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 756/1501] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:32:15 2022] PUT /identity/v3/projects/88c252b5de0541ad982c3e19daa2ac0c/users/d7bba95372f14b159c9ec4212b8e38fe/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:32:15.686863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641f6f6-d821-402c-aec8-a4cc5d5902cc None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:15.687161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641f6f6-d821-402c-aec8-a4cc5d5902cc None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:15.687418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641f6f6-d821-402c-aec8-a4cc5d5902cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:15.743479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c641f6f6-d821-402c-aec8-a4cc5d5902cc None None] MFA Rules not processed for user `d7bba95372f14b159c9ec4212b8e38fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:15.744665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c641f6f6-d821-402c-aec8-a4cc5d5902cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:15.820439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 746/1502] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:32:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:15.833538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15582666-0d16-4901-953f-69967f47c7be None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:15.833829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15582666-0d16-4901-953f-69967f47c7be None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:15.834104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15582666-0d16-4901-953f-69967f47c7be None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:15.835463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 757/1503] 10.222.0.69 () {54 vars in 964 bytes} [Thu Aug 4 02:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:32:15.840291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c55400-d773-4143-897e-d6be862f5a62 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:15.840578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c55400-d773-4143-897e-d6be862f5a62 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:15.840850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c55400-d773-4143-897e-d6be862f5a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:15.872347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:15.916332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c3c55400-d773-4143-897e-d6be862f5a62 None None] MFA Rules not processed for user `e7b8eac1856c4e7f86fe1dea9f752719`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:15.917500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c3c55400-d773-4143-897e-d6be862f5a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:15.991771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 747/1504] 10.222.0.69 () {58 vars in 1061 bytes} [Thu Aug 4 02:32:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:15.999570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15582666-0d16-4901-953f-69967f47c7be None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:16.001063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-15582666-0d16-4901-953f-69967f47c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:16.050758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:16.104212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15582666-0d16-4901-953f-69967f47c7be None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:16.175724 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:16.176264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:16.176536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:16.176801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:16.178416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:16.280429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:16.281880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:16.285909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:16.300959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 758/1505] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:32:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:32:16.345974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799ec79-31de-4067-b2e6-079ad5ac9f7e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:16.346260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799ec79-31de-4067-b2e6-079ad5ac9f7e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:16.346563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799ec79-31de-4067-b2e6-079ad5ac9f7e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:16.347834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 748/1506] 10.222.0.69 () {52 vars in 830 bytes} [Thu Aug 4 02:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:32:16.351443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:16.352645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:16.450935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd3e1-e60d-4255-9f88-c7d39aaa1f03 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:16.548402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:16.549031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:16.549308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:16.549609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] PATH_INFO: `/v3/users/d7bba95372f14b159c9ec4212b8e38fe` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:16.561989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bba95372f14b159c9ec4212b8e38fe)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:16.563010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WARNING py.warnings [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:16.563010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: warnings.warn(msg) Aug 04 02:32:16.563010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: Aug 04 02:32:16.564761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:16.574404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:16.636396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bba95372f14b159c9ec4212b8e38fe'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:16.646275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bba95372f14b159c9ec4212b8e38fe'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:16.659811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bba95372f14b159c9ec4212b8e38fe'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:16.660244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bba95372f14b159c9ec4212b8e38fe'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:16.682250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bba95372f14b159c9ec4212b8e38fe'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:16.687763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 759/1507] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:32:16 2022] DELETE /identity/v3/users/d7bba95372f14b159c9ec4212b8e38fe => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:32:16.692578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a199-9cce-4c5e-ab20-c5e4a532a362 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:16.693041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a199-9cce-4c5e-ab20-c5e4a532a362 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:16.693136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547a199-9cce-4c5e-ab20-c5e4a532a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:16.747951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7547a199-9cce-4c5e-ab20-c5e4a532a362 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:32:16.749065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7547a199-9cce-4c5e-ab20-c5e4a532a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:16.825279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:16.838549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 749/1508] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:32:16.848018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:16.849511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:16.949178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995835f2-3be6-4dc0-be99-9f862002ea42 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:17.003511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:17.023290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fd67f-db59-4d69-be5b-92c7f6affcfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:17.023905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fd67f-db59-4d69-be5b-92c7f6affcfa service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:17.024184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fd67f-db59-4d69-be5b-92c7f6affcfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:17.024454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fd67f-db59-4d69-be5b-92c7f6affcfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:17.026104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-130fd67f-db59-4d69-be5b-92c7f6affcfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:17.134146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fd67f-db59-4d69-be5b-92c7f6affcfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:17.135561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fd67f-db59-4d69-be5b-92c7f6affcfa service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:17.153791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 760/1509] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:32:17.506958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547a199-9cce-4c5e-ab20-c5e4a532a362 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:32:17.508246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7547a199-9cce-4c5e-ab20-c5e4a532a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:32:17.520176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547a199-9cce-4c5e-ab20-c5e4a532a362 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:32:17.622738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:32:17.623376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:32:17.623656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:32:17.623928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] PATH_INFO: `/v3/projects/88c252b5de0541ad982c3e19daa2ac0c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:32:17.633846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c252b5de0541ad982c3e19daa2ac0c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:32:17.634873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:32:17.634873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: warnings.warn(msg) Aug 04 02:32:17.634873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: Aug 04 02:32:17.636068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:32:17.693951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c252b5de0541ad982c3e19daa2ac0c', 'request_id': 'req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:17.702647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c252b5de0541ad982c3e19daa2ac0c', 'request_id': 'req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:17.709186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c252b5de0541ad982c3e19daa2ac0c', 'request_id': 'req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:17.738567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] The token cache is being invalidate because project 88c252b5de0541ad982c3e19daa2ac0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:32:17.738853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:17.739362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0f633f8f-a9d7-42c4-a4dc-94d82a0c90d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:32:17.740676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 750/1510] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:32:17 2022] DELETE /identity/v3/projects/88c252b5de0541ad982c3e19daa2ac0c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:32:27.151529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=62 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:32:27.736527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:33:50.818653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22205c60-d0e5-4e84-acb5-ef6f49f172dc None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:50.819314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22205c60-d0e5-4e84-acb5-ef6f49f172dc None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:50.819314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22205c60-d0e5-4e84-acb5-ef6f49f172dc None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:50.820565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:33:50.825562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89228102-7417-4d4c-8d4e-62faf6b1da05 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:50.825966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89228102-7417-4d4c-8d4e-62faf6b1da05 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:50.826078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89228102-7417-4d4c-8d4e-62faf6b1da05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:50.908461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-89228102-7417-4d4c-8d4e-62faf6b1da05 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:33:50.909694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-89228102-7417-4d4c-8d4e-62faf6b1da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:33:51.011847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:33:51.166865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22205c60-d0e5-4e84-acb5-ef6f49f172dc None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:33:51.168995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-22205c60-d0e5-4e84-acb5-ef6f49f172dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:33:51.287993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22205c60-d0e5-4e84-acb5-ef6f49f172dc None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:33:51.293607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a906270-91ae-4f07-a0cf-72d6e6021c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:33:51.294253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906270-91ae-4f07-a0cf-72d6e6021c68 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:51.294538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906270-91ae-4f07-a0cf-72d6e6021c68 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:51.294813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906270-91ae-4f07-a0cf-72d6e6021c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:51.303633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a906270-91ae-4f07-a0cf-72d6e6021c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:33:51.305226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a906270-91ae-4f07-a0cf-72d6e6021c68 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:33:51.314568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 762/1513] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:33:52.142088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68612f-c863-4974-8dc4-8af971787d01 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:52.142668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68612f-c863-4974-8dc4-8af971787d01 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:52.142668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68612f-c863-4974-8dc4-8af971787d01 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:52.144036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:33:52.148763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5d730-99bb-46fe-a793-56c27fc31cac None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:52.149165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5d730-99bb-46fe-a793-56c27fc31cac None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:52.149310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5d730-99bb-46fe-a793-56c27fc31cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:52.169665 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8fe5d730-99bb-46fe-a793-56c27fc31cac None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:33:52.170911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8fe5d730-99bb-46fe-a793-56c27fc31cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:33:52.178940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:33:52.330460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68612f-c863-4974-8dc4-8af971787d01 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:33:52.345264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68612f-c863-4974-8dc4-8af971787d01 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:33:52.350916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583aac8-a11b-4e30-b17c-ebfe4823d266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:33:52.351528 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583aac8-a11b-4e30-b17c-ebfe4823d266 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:52.351805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583aac8-a11b-4e30-b17c-ebfe4823d266 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:52.352075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583aac8-a11b-4e30-b17c-ebfe4823d266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:52.360244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583aac8-a11b-4e30-b17c-ebfe4823d266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:33:52.361858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583aac8-a11b-4e30-b17c-ebfe4823d266 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:33:52.371110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 753/1516] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:33:53.876685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecbc83-54ea-46df-a1ea-34415acfc37a None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:53.877197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecbc83-54ea-46df-a1ea-34415acfc37a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:53.877197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecbc83-54ea-46df-a1ea-34415acfc37a None None] PATH_INFO: `/v3` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:53.878468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 764/1517] 10.222.0.71 () {54 vars in 925 bytes} [Thu Aug 4 02:33:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:33:53.885912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54a90e-3e06-40f9-a3fc-5e6b6e1a34a0 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:53.886310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54a90e-3e06-40f9-a3fc-5e6b6e1a34a0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:53.886458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54a90e-3e06-40f9-a3fc-5e6b6e1a34a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:53.945876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0d54a90e-3e06-40f9-a3fc-5e6b6e1a34a0 None None] MFA Rules not processed for user `234cbff2a729458a8dad108baaba6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:33:53.947070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0d54a90e-3e06-40f9-a3fc-5e6b6e1a34a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:33:53.963750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:33:54.018610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 754/1518] 10.222.0.71 () {58 vars in 1015 bytes} [Thu Aug 4 02:33:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:33:57.869547 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b22c9-533a-4f2c-8182-4d459b6bb0b5 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:57.870070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b22c9-533a-4f2c-8182-4d459b6bb0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:57.870070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b22c9-533a-4f2c-8182-4d459b6bb0b5 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:57.871351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 765/1519] 10.222.0.69 () {54 vars in 961 bytes} [Thu Aug 4 02:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:33:57.876426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939121bc-dcdf-4011-9f12-ec312c398c21 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:57.876851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939121bc-dcdf-4011-9f12-ec312c398c21 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:57.876970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939121bc-dcdf-4011-9f12-ec312c398c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:57.897996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-939121bc-dcdf-4011-9f12-ec312c398c21 None None] MFA Rules not processed for user `234cbff2a729458a8dad108baaba6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:33:57.899183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-939121bc-dcdf-4011-9f12-ec312c398c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:33:57.908466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 755/1520] 10.222.0.69 () {58 vars in 1058 bytes} [Thu Aug 4 02:33:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:33:57.917237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b22c9-533a-4f2c-8182-4d459b6bb0b5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:33:57.931692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b22c9-533a-4f2c-8182-4d459b6bb0b5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:33:57.936886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df595496-38a8-417d-9e7e-e0098c18db8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:33:57.937543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df595496-38a8-417d-9e7e-e0098c18db8a service placement] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:33:57.937826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df595496-38a8-417d-9e7e-e0098c18db8a service placement] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:33:57.938112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df595496-38a8-417d-9e7e-e0098c18db8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:33:57.946480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df595496-38a8-417d-9e7e-e0098c18db8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:33:57.948043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df595496-38a8-417d-9e7e-e0098c18db8a service placement] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:33:57.957594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 766/1521] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:33:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:03.583191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d1c53-5663-4eb1-9a9b-0995cfdd6b31 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:03.583679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d1c53-5663-4eb1-9a9b-0995cfdd6b31 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:03.583781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d1c53-5663-4eb1-9a9b-0995cfdd6b31 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:03.585158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:03.589983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514661da-1dfb-4a9a-b11c-c4a8ca503ac9 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:03.590423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514661da-1dfb-4a9a-b11c-c4a8ca503ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:03.590536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514661da-1dfb-4a9a-b11c-c4a8ca503ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:03.610227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-514661da-1dfb-4a9a-b11c-c4a8ca503ac9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:03.611415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-514661da-1dfb-4a9a-b11c-c4a8ca503ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:03.619276 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:03.772510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d1c53-5663-4eb1-9a9b-0995cfdd6b31 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:03.787327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d1c53-5663-4eb1-9a9b-0995cfdd6b31 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:03.792726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4d2d-d034-4ea6-b665-0666029048af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:03.793342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4d2d-d034-4ea6-b665-0666029048af service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:03.793640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4d2d-d034-4ea6-b665-0666029048af service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:03.793916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4d2d-d034-4ea6-b665-0666029048af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:03.802583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4d2d-d034-4ea6-b665-0666029048af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:03.804157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4d2d-d034-4ea6-b665-0666029048af service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:03.813730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 757/1524] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:04.624729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9104d7-8a31-4982-971c-16b167e8ad27 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:04.625185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9104d7-8a31-4982-971c-16b167e8ad27 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:04.625313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9104d7-8a31-4982-971c-16b167e8ad27 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:04.626655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 02:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:04.631521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3767-7762-4bcb-bbe1-60071006bb19 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:04.631939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3767-7762-4bcb-bbe1-60071006bb19 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:04.632069 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3767-7762-4bcb-bbe1-60071006bb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:04.651112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-217d3767-7762-4bcb-bbe1-60071006bb19 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:04.652292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-217d3767-7762-4bcb-bbe1-60071006bb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:04.660537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 02:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:04.811603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9104d7-8a31-4982-971c-16b167e8ad27 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:04.826671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9104d7-8a31-4982-971c-16b167e8ad27 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:04.832374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5db1b-4733-4947-bd4a-b9ae5cc66f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:04.832985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5db1b-4733-4947-bd4a-b9ae5cc66f41 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:04.833269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5db1b-4733-4947-bd4a-b9ae5cc66f41 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:04.833570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5db1b-4733-4947-bd4a-b9ae5cc66f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:04.841789 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5db1b-4733-4947-bd4a-b9ae5cc66f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:04.843867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5db1b-4733-4947-bd4a-b9ae5cc66f41 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:04.853257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 769/1527] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:08.689422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77655ded-0434-491b-a6ec-7a5b03627e41 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:08.689910 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77655ded-0434-491b-a6ec-7a5b03627e41 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:08.690024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77655ded-0434-491b-a6ec-7a5b03627e41 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:08.691318 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:08.696554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f343ed5-dd68-4779-bb5d-dd9d48bd202b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:08.696974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f343ed5-dd68-4779-bb5d-dd9d48bd202b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:08.697084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f343ed5-dd68-4779-bb5d-dd9d48bd202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:08.716448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9f343ed5-dd68-4779-bb5d-dd9d48bd202b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:08.718314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9f343ed5-dd68-4779-bb5d-dd9d48bd202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:08.725964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:08.797573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77655ded-0434-491b-a6ec-7a5b03627e41 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:08.799261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-77655ded-0434-491b-a6ec-7a5b03627e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:08.875225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77655ded-0434-491b-a6ec-7a5b03627e41 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:08.878681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83ede8-fb97-4097-b9d6-38c12ba9adfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:08.879278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ede8-fb97-4097-b9d6-38c12ba9adfe service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:08.879554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ede8-fb97-4097-b9d6-38c12ba9adfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:08.879823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ede8-fb97-4097-b9d6-38c12ba9adfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:08.889805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83ede8-fb97-4097-b9d6-38c12ba9adfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:08.891209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83ede8-fb97-4097-b9d6-38c12ba9adfe service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:08.900378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 760/1530] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:10.882146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2a2f-d8a2-4865-b54c-03594faaec4b None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:10.882656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2a2f-d8a2-4865-b54c-03594faaec4b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:10.882656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c2a2f-d8a2-4865-b54c-03594faaec4b None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:10.883968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:10.889484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b5e4-1139-472a-9294-dc09d1e7d667 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:10.889899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b5e4-1139-472a-9294-dc09d1e7d667 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:10.890042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b5e4-1139-472a-9294-dc09d1e7d667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:10.909059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1662b5e4-1139-472a-9294-dc09d1e7d667 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:10.910563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1662b5e4-1139-472a-9294-dc09d1e7d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:10.918336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:10.960465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2a2f-d8a2-4865-b54c-03594faaec4b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:10.971360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c2a2f-d8a2-4865-b54c-03594faaec4b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:10.974909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05cbc7-1fd2-46f0-b158-66ce00865e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:10.975512 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05cbc7-1fd2-46f0-b158-66ce00865e90 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:10.975792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05cbc7-1fd2-46f0-b158-66ce00865e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:10.976064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05cbc7-1fd2-46f0-b158-66ce00865e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:10.985422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05cbc7-1fd2-46f0-b158-66ce00865e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:10.986830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05cbc7-1fd2-46f0-b158-66ce00865e90 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:10.996121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 772/1533] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:14.462033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce1eb-5342-47ec-9d7e-11eaa3b4863f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:14.462586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce1eb-5342-47ec-9d7e-11eaa3b4863f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:14.462586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ce1eb-5342-47ec-9d7e-11eaa3b4863f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:14.463928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:14.469469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb81be-16b6-40b2-aed5-fbf1ec8f9de6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:14.469887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb81be-16b6-40b2-aed5-fbf1ec8f9de6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:14.470040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb81be-16b6-40b2-aed5-fbf1ec8f9de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:14.489657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-1cfb81be-16b6-40b2-aed5-fbf1ec8f9de6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:14.490833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1cfb81be-16b6-40b2-aed5-fbf1ec8f9de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:14.498561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:14.799628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ce1eb-5342-47ec-9d7e-11eaa3b4863f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:14.801320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6e5ce1eb-5342-47ec-9d7e-11eaa3b4863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:14.865713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:14.879045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ce1eb-5342-47ec-9d7e-11eaa3b4863f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:14.882595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946575f3-449b-4127-9cf0-a0ea437f0a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:14.883204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946575f3-449b-4127-9cf0-a0ea437f0a64 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:14.883481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946575f3-449b-4127-9cf0-a0ea437f0a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:14.883752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946575f3-449b-4127-9cf0-a0ea437f0a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:14.893343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946575f3-449b-4127-9cf0-a0ea437f0a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:14.894765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946575f3-449b-4127-9cf0-a0ea437f0a64 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:14.904012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 763/1536] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:16.905295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee764f-0b6f-49c2-a607-c5f41caf8211 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:16.905858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee764f-0b6f-49c2-a607-c5f41caf8211 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:16.905858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee764f-0b6f-49c2-a607-c5f41caf8211 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:16.907247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 02:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:34:16.912376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1ae75-016b-41e6-8c6a-04b916ad0617 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:16.912798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1ae75-016b-41e6-8c6a-04b916ad0617 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:16.912925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1ae75-016b-41e6-8c6a-04b916ad0617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:16.932688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0ac1ae75-016b-41e6-8c6a-04b916ad0617 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:34:16.933929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0ac1ae75-016b-41e6-8c6a-04b916ad0617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:16.942473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 02:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:34:17.242722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee764f-0b6f-49c2-a607-c5f41caf8211 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:34:17.244401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3dee764f-0b6f-49c2-a607-c5f41caf8211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:34:17.251979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=84 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:17.258328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee764f-0b6f-49c2-a607-c5f41caf8211 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:34:17.262129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1764-4f32-4eac-8c5d-664a4049a039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:34:17.262731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1764-4f32-4eac-8c5d-664a4049a039 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:34:17.263012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1764-4f32-4eac-8c5d-664a4049a039 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:34:17.263287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1764-4f32-4eac-8c5d-664a4049a039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:34:17.272263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1764-4f32-4eac-8c5d-664a4049a039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:34:17.273702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1764-4f32-4eac-8c5d-664a4049a039 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:34:17.283543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 775/1539] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:34:26.927850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=11 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:34:27.278854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=5 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:43.500250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef538dcb-4d3d-4b99-8743-1052e16a39c9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.501631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef538dcb-4d3d-4b99-8743-1052e16a39c9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.505060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef538dcb-4d3d-4b99-8743-1052e16a39c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.525726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ef538dcb-4d3d-4b99-8743-1052e16a39c9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.527414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ef538dcb-4d3d-4b99-8743-1052e16a39c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.538473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 765/1540] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.547359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fb22b-658f-46e7-9c07-8aab45f15297 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.547923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fb22b-658f-46e7-9c07-8aab45f15297 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.547923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fb22b-658f-46e7-9c07-8aab45f15297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.574013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-347fb22b-658f-46e7-9c07-8aab45f15297 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.575945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-347fb22b-658f-46e7-9c07-8aab45f15297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.588781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dac92-044e-4454-8b16-3c852a30af90 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.589471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dac92-044e-4454-8b16-3c852a30af90 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.590027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dac92-044e-4454-8b16-3c852a30af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.591879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 776/1541] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.596402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fb22b-658f-46e7-9c07-8aab45f15297 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:43.616613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fb22b-658f-46e7-9c07-8aab45f15297 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:43.623920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a71c53-4d69-42be-a077-4fcd74bd3561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:43.624552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71c53-4d69-42be-a077-4fcd74bd3561 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.624836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71c53-4d69-42be-a077-4fcd74bd3561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.625107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71c53-4d69-42be-a077-4fcd74bd3561 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.625843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a71c53-4d69-42be-a077-4fcd74bd3561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:43.626141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a71c53-4d69-42be-a077-4fcd74bd3561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:43.627158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WARNING py.warnings [None req-98a71c53-4d69-42be-a077-4fcd74bd3561 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:35:43.627158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: warnings.warn(msg) Aug 04 02:35:43.627158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: Aug 04 02:35:43.628030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a71c53-4d69-42be-a077-4fcd74bd3561 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:43.630936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-fe4dac92-044e-4454-8b16-3c852a30af90 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.632404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fe4dac92-044e-4454-8b16-3c852a30af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.647500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 777/1542] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:35:43.655142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e23ef-3990-48ac-9f78-34f08e5227be None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.655427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e23ef-3990-48ac-9f78-34f08e5227be None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.655775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e23ef-3990-48ac-9f78-34f08e5227be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.660201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 766/1543] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.661014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dac92-044e-4454-8b16-3c852a30af90 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:43.683506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dac92-044e-4454-8b16-3c852a30af90 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:43.705028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fb819-a1c1-454b-94d9-d3d15b7b3f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:43.705697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fb819-a1c1-454b-94d9-d3d15b7b3f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.705966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fb819-a1c1-454b-94d9-d3d15b7b3f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.706235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fb819-a1c1-454b-94d9-d3d15b7b3f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.707025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fb819-a1c1-454b-94d9-d3d15b7b3f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:43.707929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-5e5fb819-a1c1-454b-94d9-d3d15b7b3f63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:35:43.707929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: warnings.warn(msg) Aug 04 02:35:43.707929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: Aug 04 02:35:43.709094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fb819-a1c1-454b-94d9-d3d15b7b3f63 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:43.720825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-272e23ef-3990-48ac-9f78-34f08e5227be None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.722053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-272e23ef-3990-48ac-9f78-34f08e5227be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.739784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 778/1544] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.740860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c80f30-570e-4c2b-98ad-6854d13644de None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.741140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c80f30-570e-4c2b-98ad-6854d13644de None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.745844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c80f30-570e-4c2b-98ad-6854d13644de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.770262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-56c80f30-570e-4c2b-98ad-6854d13644de None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.771645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-56c80f30-570e-4c2b-98ad-6854d13644de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.781142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 767/1545] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:43.782451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9f627-df5d-49b0-be79-bdf8cccf277d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.782734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9f627-df5d-49b0-be79-bdf8cccf277d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.784123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9f627-df5d-49b0-be79-bdf8cccf277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.784250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 779/1546] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.784481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3c79-0fdd-4693-82b2-a949e2d641c0 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.784718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3c79-0fdd-4693-82b2-a949e2d641c0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.784991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3c79-0fdd-4693-82b2-a949e2d641c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.803697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d0b9f627-df5d-49b0-be79-bdf8cccf277d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.804875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d0b9f627-df5d-49b0-be79-bdf8cccf277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.805554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f9ec3c79-0fdd-4693-82b2-a949e2d641c0 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.806766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f9ec3c79-0fdd-4693-82b2-a949e2d641c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.864076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 768/1547] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.865436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082af15-0bc5-401c-9196-91648f91f73a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.865728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082af15-0bc5-401c-9196-91648f91f73a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.866001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082af15-0bc5-401c-9196-91648f91f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.876504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 780/1548] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.876504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40523d-8907-4c91-a3f9-01a8b2aa0fd8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.876504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40523d-8907-4c91-a3f9-01a8b2aa0fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.876504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40523d-8907-4c91-a3f9-01a8b2aa0fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.890018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bc40523d-8907-4c91-a3f9-01a8b2aa0fd8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.891205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bc40523d-8907-4c91-a3f9-01a8b2aa0fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.893258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b082af15-0bc5-401c-9196-91648f91f73a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.894451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b082af15-0bc5-401c-9196-91648f91f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.899008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 781/1549] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.900109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef3fa0-7909-4bb3-99fa-2752e8fe8000 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.900434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef3fa0-7909-4bb3-99fa-2752e8fe8000 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.900655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef3fa0-7909-4bb3-99fa-2752e8fe8000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.903208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 769/1550] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.904392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff7a13-d3fc-4ce0-ab40-7fecdb582a44 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.904817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff7a13-d3fc-4ce0-ab40-7fecdb582a44 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.905088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff7a13-d3fc-4ce0-ab40-7fecdb582a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.921351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-dfef3fa0-7909-4bb3-99fa-2752e8fe8000 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.922671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-dfef3fa0-7909-4bb3-99fa-2752e8fe8000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.926097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-75ff7a13-d3fc-4ce0-ab40-7fecdb582a44 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.927246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-75ff7a13-d3fc-4ce0-ab40-7fecdb582a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:43.930584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 782/1551] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.931336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef3fa0-7909-4bb3-99fa-2752e8fe8000 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:43.938651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 770/1552] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:43.939506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff7a13-d3fc-4ce0-ab40-7fecdb582a44 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:43.947972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef3fa0-7909-4bb3-99fa-2752e8fe8000 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:43.950673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff7a13-d3fc-4ce0-ab40-7fecdb582a44 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:43.952614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499dc4-0385-41e6-8fde-1575d98b44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:43.953246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499dc4-0385-41e6-8fde-1575d98b44a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.953640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499dc4-0385-41e6-8fde-1575d98b44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.953909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499dc4-0385-41e6-8fde-1575d98b44a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.954568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5499dc4-0385-41e6-8fde-1575d98b44a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:43.955451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd276-caa4-4894-b03d-639493929d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:43.955590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WARNING py.warnings [None req-a5499dc4-0385-41e6-8fde-1575d98b44a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:35:43.955590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: warnings.warn(msg) Aug 04 02:35:43.955590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: Aug 04 02:35:43.956073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd276-caa4-4894-b03d-639493929d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.956348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd276-caa4-4894-b03d-639493929d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.956615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd276-caa4-4894-b03d-639493929d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.956723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5499dc4-0385-41e6-8fde-1575d98b44a2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:43.957296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd276-caa4-4894-b03d-639493929d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:43.957623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd276-caa4-4894-b03d-639493929d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:43.959184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd276-caa4-4894-b03d-639493929d0e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:43.971125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 771/1553] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:43.978625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d48db-7d6e-4f0b-a9a5-221b8e544684 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.978625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d48db-7d6e-4f0b-a9a5-221b8e544684 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.978625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d48db-7d6e-4f0b-a9a5-221b8e544684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.984883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 783/1554] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:43.986191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf2cda-c321-4908-9412-3c251420f8a0 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:43.986479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf2cda-c321-4908-9412-3c251420f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:43.986754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf2cda-c321-4908-9412-3c251420f8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:43.995016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c74d48db-7d6e-4f0b-a9a5-221b8e544684 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:43.996258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c74d48db-7d6e-4f0b-a9a5-221b8e544684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:44.004649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 772/1555] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:44.005449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d48db-7d6e-4f0b-a9a5-221b8e544684 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.006623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ffbf2cda-c321-4908-9412-3c251420f8a0 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:44.007787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ffbf2cda-c321-4908-9412-3c251420f8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:44.014757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d48db-7d6e-4f0b-a9a5-221b8e544684 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.015825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 784/1556] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:44.016986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf56eb2-9bbb-40c8-a7d9-b5dab78ed7cb None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.017265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf56eb2-9bbb-40c8-a7d9-b5dab78ed7cb None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.017569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf56eb2-9bbb-40c8-a7d9-b5dab78ed7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.022739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece0484-07fd-4b1d-9223-8a67e4b12e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.023272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece0484-07fd-4b1d-9223-8a67e4b12e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.023549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece0484-07fd-4b1d-9223-8a67e4b12e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.023819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece0484-07fd-4b1d-9223-8a67e4b12e9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.024494 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece0484-07fd-4b1d-9223-8a67e4b12e9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:44.024857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece0484-07fd-4b1d-9223-8a67e4b12e9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.026379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece0484-07fd-4b1d-9223-8a67e4b12e9a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.036698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-caf56eb2-9bbb-40c8-a7d9-b5dab78ed7cb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:44.037931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-caf56eb2-9bbb-40c8-a7d9-b5dab78ed7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:44.038332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 773/1557] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:44.039650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23dc16-1fdd-4eff-ba06-9e80c34a3b06 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.039939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23dc16-1fdd-4eff-ba06-9e80c34a3b06 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.040209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23dc16-1fdd-4eff-ba06-9e80c34a3b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.052048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 785/1558] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:44.053571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597312cd-958a-48cd-8cb2-647a154468db None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.053975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597312cd-958a-48cd-8cb2-647a154468db None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.054287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597312cd-958a-48cd-8cb2-647a154468db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.060189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1f23dc16-1fdd-4eff-ba06-9e80c34a3b06 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:44.061390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1f23dc16-1fdd-4eff-ba06-9e80c34a3b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:44.069146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 774/1559] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:44.069929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23dc16-1fdd-4eff-ba06-9e80c34a3b06 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.074289 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-597312cd-958a-48cd-8cb2-647a154468db None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:44.075482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-597312cd-958a-48cd-8cb2-647a154468db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:44.079274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23dc16-1fdd-4eff-ba06-9e80c34a3b06 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.083264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 786/1560] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:44.083773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb42f94-4f82-440f-b624-4aa3f3608691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.084032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597312cd-958a-48cd-8cb2-647a154468db None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.084438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb42f94-4f82-440f-b624-4aa3f3608691 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.084708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb42f94-4f82-440f-b624-4aa3f3608691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.084981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb42f94-4f82-440f-b624-4aa3f3608691 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.085662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb42f94-4f82-440f-b624-4aa3f3608691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.087716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb42f94-4f82-440f-b624-4aa3f3608691 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.093279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597312cd-958a-48cd-8cb2-647a154468db None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.097715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f24f2-c845-4ebf-b1ad-c1b537ac517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.098300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f24f2-c845-4ebf-b1ad-c1b537ac517f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.098574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f24f2-c845-4ebf-b1ad-c1b537ac517f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.098845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f24f2-c845-4ebf-b1ad-c1b537ac517f admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.099532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f24f2-c845-4ebf-b1ad-c1b537ac517f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.101122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f24f2-c845-4ebf-b1ad-c1b537ac517f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.112292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 787/1561] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:44.113093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f24f2-c845-4ebf-b1ad-c1b537ac517f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.117657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 775/1562] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.118687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb42f94-4f82-440f-b624-4aa3f3608691 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.125389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f24f2-c845-4ebf-b1ad-c1b537ac517f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.163881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:44.182567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038033-cd7a-4468-b628-a11e5de922db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.183186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038033-cd7a-4468-b628-a11e5de922db admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.183309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb42f94-4f82-440f-b624-4aa3f3608691 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.183468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038033-cd7a-4468-b628-a11e5de922db admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.184240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038033-cd7a-4468-b628-a11e5de922db admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.184992 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9038033-cd7a-4468-b628-a11e5de922db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:44.185293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9038033-cd7a-4468-b628-a11e5de922db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.186954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9038033-cd7a-4468-b628-a11e5de922db admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.188386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5cf74-9169-4da8-acba-9626065d7d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.189622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5cf74-9169-4da8-acba-9626065d7d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.189901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5cf74-9169-4da8-acba-9626065d7d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.190168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5cf74-9169-4da8-acba-9626065d7d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.190849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5cf74-9169-4da8-acba-9626065d7d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:44.191147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5cf74-9169-4da8-acba-9626065d7d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.192703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5cf74-9169-4da8-acba-9626065d7d04 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.195599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:44.200494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 788/1563] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:44.201288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038033-cd7a-4468-b628-a11e5de922db admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.212415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 776/1564] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:44.212415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5cf74-9169-4da8-acba-9626065d7d04 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.212942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038033-cd7a-4468-b628-a11e5de922db admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.218020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5cf74-9169-4da8-acba-9626065d7d04 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.218442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89376bd9-ea7f-481a-b778-f4637d41ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.219074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89376bd9-ea7f-481a-b778-f4637d41ecf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.219349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89376bd9-ea7f-481a-b778-f4637d41ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.219619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89376bd9-ea7f-481a-b778-f4637d41ecf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.220280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89376bd9-ea7f-481a-b778-f4637d41ecf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.222318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89376bd9-ea7f-481a-b778-f4637d41ecf4 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.222624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845a95c-8f9f-4103-a431-cb85cb0e9a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.223219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845a95c-8f9f-4103-a431-cb85cb0e9a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.223496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845a95c-8f9f-4103-a431-cb85cb0e9a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.223763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845a95c-8f9f-4103-a431-cb85cb0e9a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.224434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845a95c-8f9f-4103-a431-cb85cb0e9a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:44.224730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845a95c-8f9f-4103-a431-cb85cb0e9a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.226327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845a95c-8f9f-4103-a431-cb85cb0e9a6f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.238764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 777/1565] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:44.239700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845a95c-8f9f-4103-a431-cb85cb0e9a6f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.249966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845a95c-8f9f-4103-a431-cb85cb0e9a6f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.254664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04704802-4497-4a07-9974-262add287aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.255257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704802-4497-4a07-9974-262add287aee admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.255536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704802-4497-4a07-9974-262add287aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.255806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704802-4497-4a07-9974-262add287aee admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.256293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 789/1566] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.257109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89376bd9-ea7f-481a-b778-f4637d41ecf4 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.260071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04704802-4497-4a07-9974-262add287aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:44.260398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04704802-4497-4a07-9974-262add287aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.262645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04704802-4497-4a07-9974-262add287aee admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.274713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 778/1567] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:44.275772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04704802-4497-4a07-9974-262add287aee admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.285217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04704802-4497-4a07-9974-262add287aee admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.326410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89376bd9-ea7f-481a-b778-f4637d41ecf4 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.331388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab490-4849-439b-b43f-3fb32ffb3d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.332005 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab490-4849-439b-b43f-3fb32ffb3d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.332286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab490-4849-439b-b43f-3fb32ffb3d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.332563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab490-4849-439b-b43f-3fb32ffb3d4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.333512 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab490-4849-439b-b43f-3fb32ffb3d4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:44.333662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab490-4849-439b-b43f-3fb32ffb3d4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.335169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab490-4849-439b-b43f-3fb32ffb3d4e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.343079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d2dd8-be63-4203-8cc0-dc7bdf955328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.343893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d2dd8-be63-4203-8cc0-dc7bdf955328 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.344215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d2dd8-be63-4203-8cc0-dc7bdf955328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.344487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d2dd8-be63-4203-8cc0-dc7bdf955328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.345152 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d2dd8-be63-4203-8cc0-dc7bdf955328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.346763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d2dd8-be63-4203-8cc0-dc7bdf955328 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.354633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 790/1568] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:44.354633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab490-4849-439b-b43f-3fb32ffb3d4e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.358052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab490-4849-439b-b43f-3fb32ffb3d4e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.362822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134e1c-8bcb-4b9e-bc4e-ec73c7f568a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.363476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134e1c-8bcb-4b9e-bc4e-ec73c7f568a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.363799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134e1c-8bcb-4b9e-bc4e-ec73c7f568a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.364101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134e1c-8bcb-4b9e-bc4e-ec73c7f568a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.367640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 779/1569] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:44.367793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68134e1c-8bcb-4b9e-bc4e-ec73c7f568a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.367909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d2dd8-be63-4203-8cc0-dc7bdf955328 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.368030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68134e1c-8bcb-4b9e-bc4e-ec73c7f568a3 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.375961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d2dd8-be63-4203-8cc0-dc7bdf955328 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.381217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b966f9-e0af-47ac-bddc-842ec378c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.381890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b966f9-e0af-47ac-bddc-842ec378c70d admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.382192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b966f9-e0af-47ac-bddc-842ec378c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.382597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b966f9-e0af-47ac-bddc-842ec378c70d admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.383541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b966f9-e0af-47ac-bddc-842ec378c70d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.385594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b966f9-e0af-47ac-bddc-842ec378c70d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.391960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 791/1570] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.394243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134e1c-8bcb-4b9e-bc4e-ec73c7f568a3 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.404310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134e1c-8bcb-4b9e-bc4e-ec73c7f568a3 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.409761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a85e-bd5a-423e-9128-9ddbc815d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.410358 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a85e-bd5a-423e-9128-9ddbc815d619 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.410641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a85e-bd5a-423e-9128-9ddbc815d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.410911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a85e-bd5a-423e-9128-9ddbc815d619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.411557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a85e-bd5a-423e-9128-9ddbc815d619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.413464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a85e-bd5a-423e-9128-9ddbc815d619 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.417609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 780/1571] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.417609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b966f9-e0af-47ac-bddc-842ec378c70d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.445510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 792/1572] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.445510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a85e-bd5a-423e-9128-9ddbc815d619 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.481660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b966f9-e0af-47ac-bddc-842ec378c70d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.505796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a85e-bd5a-423e-9128-9ddbc815d619 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.510691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:44.511216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dc203-3ac8-46f7-9416-c70b6676527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.511343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dc203-3ac8-46f7-9416-c70b6676527b admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.511604 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dc203-3ac8-46f7-9416-c70b6676527b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.512565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dc203-3ac8-46f7-9416-c70b6676527b admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.513466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dc203-3ac8-46f7-9416-c70b6676527b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.515563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dc203-3ac8-46f7-9416-c70b6676527b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.536231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 793/1573] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.537012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dc203-3ac8-46f7-9416-c70b6676527b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.539705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741909b0-ca05-4de5-82a2-7ee4d43b0c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.540322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741909b0-ca05-4de5-82a2-7ee4d43b0c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.540604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741909b0-ca05-4de5-82a2-7ee4d43b0c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.540880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741909b0-ca05-4de5-82a2-7ee4d43b0c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.541578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741909b0-ca05-4de5-82a2-7ee4d43b0c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.543989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741909b0-ca05-4de5-82a2-7ee4d43b0c0a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.546804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dc203-3ac8-46f7-9416-c70b6676527b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.551323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb53bb2-2fac-445d-8fb7-e04871121a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.551921 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb53bb2-2fac-445d-8fb7-e04871121a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.552195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb53bb2-2fac-445d-8fb7-e04871121a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.552464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb53bb2-2fac-445d-8fb7-e04871121a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.553150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb53bb2-2fac-445d-8fb7-e04871121a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.555052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb53bb2-2fac-445d-8fb7-e04871121a08 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.574239 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 781/1574] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.575291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741909b0-ca05-4de5-82a2-7ee4d43b0c0a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.582032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:44.592284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 794/1575] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.592284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb53bb2-2fac-445d-8fb7-e04871121a08 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.638496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741909b0-ca05-4de5-82a2-7ee4d43b0c0a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.654685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb53bb2-2fac-445d-8fb7-e04871121a08 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.659290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a81d2-81dd-4608-917a-28ded77ed340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.659959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a81d2-81dd-4608-917a-28ded77ed340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.660239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a81d2-81dd-4608-917a-28ded77ed340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.660507 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a81d2-81dd-4608-917a-28ded77ed340 admin admin] PATH_INFO: `/v3/projects/46a6b96eb6214e93b79c7e9c41c3aad0/users/402d29e2c7ce47cfbbb8376fbf85a0ac/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.675244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a81d2-81dd-4608-917a-28ded77ed340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a6b96eb6214e93b79c7e9c41c3aad0, user_id=402d29e2c7ce47cfbbb8376fbf85a0ac, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.677953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a81d2-81dd-4608-917a-28ded77ed340 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.691734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 795/1576] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:44 2022] PUT /identity/v3/projects/46a6b96eb6214e93b79c7e9c41c3aad0/users/402d29e2c7ce47cfbbb8376fbf85a0ac/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:44.692679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a81d2-81dd-4608-917a-28ded77ed340 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.697127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0c055-9a24-41be-b203-882ea4849640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.697794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0c055-9a24-41be-b203-882ea4849640 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.698072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0c055-9a24-41be-b203-882ea4849640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.698344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0c055-9a24-41be-b203-882ea4849640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.699006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0c055-9a24-41be-b203-882ea4849640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.700958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0c055-9a24-41be-b203-882ea4849640 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.727208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 782/1577] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.728265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0c055-9a24-41be-b203-882ea4849640 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.756245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a81d2-81dd-4608-917a-28ded77ed340 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.779313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:44.794113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0c055-9a24-41be-b203-882ea4849640 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.798654 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c92627-b18a-43e9-92b1-be7e432db1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.799272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c92627-b18a-43e9-92b1-be7e432db1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.799550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c92627-b18a-43e9-92b1-be7e432db1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.799818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c92627-b18a-43e9-92b1-be7e432db1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.800472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c92627-b18a-43e9-92b1-be7e432db1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.802418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c92627-b18a-43e9-92b1-be7e432db1c0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.813185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b518a4-523b-48ba-8482-1a1af192ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.813840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b518a4-523b-48ba-8482-1a1af192ad74 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.814126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b518a4-523b-48ba-8482-1a1af192ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.814402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b518a4-523b-48ba-8482-1a1af192ad74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.815092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b518a4-523b-48ba-8482-1a1af192ad74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.816753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b518a4-523b-48ba-8482-1a1af192ad74 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.823918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 783/1578] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.824884 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c92627-b18a-43e9-92b1-be7e432db1c0 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.827335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 796/1579] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:44.828369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b518a4-523b-48ba-8482-1a1af192ad74 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.835527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c92627-b18a-43e9-92b1-be7e432db1c0 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.837886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b518a4-523b-48ba-8482-1a1af192ad74 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.840376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7deff8-369a-43b5-a2b5-e5977911232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.840967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7deff8-369a-43b5-a2b5-e5977911232d admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.841247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7deff8-369a-43b5-a2b5-e5977911232d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.841560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7deff8-369a-43b5-a2b5-e5977911232d admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.842211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7deff8-369a-43b5-a2b5-e5977911232d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.842763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbfb15-41b7-4a9c-9d2b-ba09215a91d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.843414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbfb15-41b7-4a9c-9d2b-ba09215a91d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.843690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbfb15-41b7-4a9c-9d2b-ba09215a91d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.843962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbfb15-41b7-4a9c-9d2b-ba09215a91d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.844120 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7deff8-369a-43b5-a2b5-e5977911232d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.844634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbfb15-41b7-4a9c-9d2b-ba09215a91d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.846209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbfb15-41b7-4a9c-9d2b-ba09215a91d1 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.856704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 797/1580] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:44.857675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbfb15-41b7-4a9c-9d2b-ba09215a91d1 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.867499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbfb15-41b7-4a9c-9d2b-ba09215a91d1 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.871184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 784/1581] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.871184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7deff8-369a-43b5-a2b5-e5977911232d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.872629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0afae6-9749-449e-804c-8bd991056d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.873211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0afae6-9749-449e-804c-8bd991056d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.873521 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0afae6-9749-449e-804c-8bd991056d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.873794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0afae6-9749-449e-804c-8bd991056d39 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.874437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0afae6-9749-449e-804c-8bd991056d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.876338 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0afae6-9749-449e-804c-8bd991056d39 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.879766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7deff8-369a-43b5-a2b5-e5977911232d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.884617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84f52d-7747-43f6-b5a6-f8ea27300fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.885205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84f52d-7747-43f6-b5a6-f8ea27300fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.885522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84f52d-7747-43f6-b5a6-f8ea27300fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.885797 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84f52d-7747-43f6-b5a6-f8ea27300fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.886444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84f52d-7747-43f6-b5a6-f8ea27300fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.888645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84f52d-7747-43f6-b5a6-f8ea27300fa8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.892738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:44.901509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 798/1582] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.903451 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4b5a9-2e2b-4f35-b61e-b4e2a627a739 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.903920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4b5a9-2e2b-4f35-b61e-b4e2a627a739 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.904596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4b5a9-2e2b-4f35-b61e-b4e2a627a739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.914794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 785/1583] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.914794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84f52d-7747-43f6-b5a6-f8ea27300fa8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.925380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84f52d-7747-43f6-b5a6-f8ea27300fa8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.927636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bcf4b5a9-2e2b-4f35-b61e-b4e2a627a739 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:44.929030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bcf4b5a9-2e2b-4f35-b61e-b4e2a627a739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:44.930153 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66c2c5-c2ba-4d9a-8e8c-6e63dfc70eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.930752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c2c5-c2ba-4d9a-8e8c-6e63dfc70eba admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.931094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c2c5-c2ba-4d9a-8e8c-6e63dfc70eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.931372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c2c5-c2ba-4d9a-8e8c-6e63dfc70eba admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.932148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66c2c5-c2ba-4d9a-8e8c-6e63dfc70eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.934146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66c2c5-c2ba-4d9a-8e8c-6e63dfc70eba admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.936781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 799/1584] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:44.937583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4b5a9-2e2b-4f35-b61e-b4e2a627a739 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.947523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4b5a9-2e2b-4f35-b61e-b4e2a627a739 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.952501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd0312-e081-4b0c-a3d6-0b8eb319151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.953117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd0312-e081-4b0c-a3d6-0b8eb319151e admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.953428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd0312-e081-4b0c-a3d6-0b8eb319151e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.953731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd0312-e081-4b0c-a3d6-0b8eb319151e admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.954402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd0312-e081-4b0c-a3d6-0b8eb319151e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.955987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd0312-e081-4b0c-a3d6-0b8eb319151e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.956918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 786/1585] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:44 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:44.957764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66c2c5-c2ba-4d9a-8e8c-6e63dfc70eba admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.969961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 800/1586] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:44.970137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66c2c5-c2ba-4d9a-8e8c-6e63dfc70eba admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.970259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd0312-e081-4b0c-a3d6-0b8eb319151e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.972231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b46e2-a6e8-4117-bdf8-f54da3f4a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.972818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b46e2-a6e8-4117-bdf8-f54da3f4a66b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.973095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b46e2-a6e8-4117-bdf8-f54da3f4a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.973388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b46e2-a6e8-4117-bdf8-f54da3f4a66b admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.974064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b46e2-a6e8-4117-bdf8-f54da3f4a66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.975632 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b46e2-a6e8-4117-bdf8-f54da3f4a66b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.978045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd0312-e081-4b0c-a3d6-0b8eb319151e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:44.983146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9c7fe-990c-4439-9dd0-5a5c43970a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:44.983726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9c7fe-990c-4439-9dd0-5a5c43970a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:44.984009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9c7fe-990c-4439-9dd0-5a5c43970a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:44.984287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9c7fe-990c-4439-9dd0-5a5c43970a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:44.984993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9c7fe-990c-4439-9dd0-5a5c43970a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:44.989030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 787/1587] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:44.989184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9c7fe-990c-4439-9dd0-5a5c43970a0b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:44.989314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b46e2-a6e8-4117-bdf8-f54da3f4a66b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:44.995952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b46e2-a6e8-4117-bdf8-f54da3f4a66b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.001232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 801/1588] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.001232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9c7fe-990c-4439-9dd0-5a5c43970a0b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.001488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cce4a-56e5-4ef0-8e62-1556c0d71157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.001488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cce4a-56e5-4ef0-8e62-1556c0d71157 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.001488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cce4a-56e5-4ef0-8e62-1556c0d71157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.001747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cce4a-56e5-4ef0-8e62-1556c0d71157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.002320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cce4a-56e5-4ef0-8e62-1556c0d71157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.003867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cce4a-56e5-4ef0-8e62-1556c0d71157 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.009075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9c7fe-990c-4439-9dd0-5a5c43970a0b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.013807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07246-bab9-458a-a16b-d24117626c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.017067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 788/1589] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.017227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07246-bab9-458a-a16b-d24117626c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.017227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07246-bab9-458a-a16b-d24117626c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.017227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07246-bab9-458a-a16b-d24117626c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.017520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cce4a-56e5-4ef0-8e62-1556c0d71157 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.017613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c07246-bab9-458a-a16b-d24117626c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.017716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c07246-bab9-458a-a16b-d24117626c45 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.024043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cce4a-56e5-4ef0-8e62-1556c0d71157 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.031512 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 802/1590] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.031646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1929012-9ffa-4a70-a5bb-4d79780cc181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.031646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1929012-9ffa-4a70-a5bb-4d79780cc181 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.031945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07246-bab9-458a-a16b-d24117626c45 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.032069 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1929012-9ffa-4a70-a5bb-4d79780cc181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.032069 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1929012-9ffa-4a70-a5bb-4d79780cc181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.032069 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1929012-9ffa-4a70-a5bb-4d79780cc181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.032416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1929012-9ffa-4a70-a5bb-4d79780cc181 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.042503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 789/1591] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.043832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1929012-9ffa-4a70-a5bb-4d79780cc181 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.053211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1929012-9ffa-4a70-a5bb-4d79780cc181 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.057673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b108d5-520d-4875-9097-63ccd1954dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.058227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b108d5-520d-4875-9097-63ccd1954dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.058502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b108d5-520d-4875-9097-63ccd1954dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.058806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b108d5-520d-4875-9097-63ccd1954dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.059463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b108d5-520d-4875-9097-63ccd1954dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.061003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b108d5-520d-4875-9097-63ccd1954dfc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.070628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 790/1592] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.071394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b108d5-520d-4875-9097-63ccd1954dfc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.082885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b108d5-520d-4875-9097-63ccd1954dfc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.087448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f082-f2b7-4958-bfa8-a2881464c014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.088049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f082-f2b7-4958-bfa8-a2881464c014 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.088385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f082-f2b7-4958-bfa8-a2881464c014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.088588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f082-f2b7-4958-bfa8-a2881464c014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.089253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1f082-f2b7-4958-bfa8-a2881464c014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.089392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07246-bab9-458a-a16b-d24117626c45 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.091325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1f082-f2b7-4958-bfa8-a2881464c014 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.094041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465cb2b-1d36-4f46-ac1e-ce70433fda34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.094640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465cb2b-1d36-4f46-ac1e-ce70433fda34 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.094915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465cb2b-1d36-4f46-ac1e-ce70433fda34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.095182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465cb2b-1d36-4f46-ac1e-ce70433fda34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.101530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 791/1593] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.101530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f082-f2b7-4958-bfa8-a2881464c014 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.104797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465cb2b-1d36-4f46-ac1e-ce70433fda34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.106620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465cb2b-1d36-4f46-ac1e-ce70433fda34 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.112526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f082-f2b7-4958-bfa8-a2881464c014 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.116248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 803/1594] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:45.117004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465cb2b-1d36-4f46-ac1e-ce70433fda34 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.117141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4fe9d-3b92-4ae7-8b14-0f63f916299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.117832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4fe9d-3b92-4ae7-8b14-0f63f916299b admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.118111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4fe9d-3b92-4ae7-8b14-0f63f916299b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.118382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4fe9d-3b92-4ae7-8b14-0f63f916299b admin admin] PATH_INFO: `/v3/projects/6f92bcbe02bd4ddead54adba555e3f3d/users/a1631559d5194f1fa449a16f93546349/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.126099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465cb2b-1d36-4f46-ac1e-ce70433fda34 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.131259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caad186-eb34-4888-a3be-05236944b78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.131914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caad186-eb34-4888-a3be-05236944b78d admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.132241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caad186-eb34-4888-a3be-05236944b78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.132469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caad186-eb34-4888-a3be-05236944b78d admin admin] PATH_INFO: `/v3/projects/5bca4982077b47d9bfd1f1b22179113a/users/8f5292aec821483287e5965190ed6b0d/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.133838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4fe9d-3b92-4ae7-8b14-0f63f916299b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f92bcbe02bd4ddead54adba555e3f3d, user_id=a1631559d5194f1fa449a16f93546349, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.135292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-edd4fe9d-3b92-4ae7-8b14-0f63f916299b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:35:45.135292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: warnings.warn(msg) Aug 04 02:35:45.135292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: Aug 04 02:35:45.137079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4fe9d-3b92-4ae7-8b14-0f63f916299b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.149956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caad186-eb34-4888-a3be-05236944b78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bca4982077b47d9bfd1f1b22179113a, user_id=8f5292aec821483287e5965190ed6b0d, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.156383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 792/1595] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:45 2022] PUT /identity/v3/projects/6f92bcbe02bd4ddead54adba555e3f3d/users/a1631559d5194f1fa449a16f93546349/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:45.156383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4fe9d-3b92-4ae7-8b14-0f63f916299b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.156659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caad186-eb34-4888-a3be-05236944b78d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.179766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 804/1596] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:45 2022] PUT /identity/v3/projects/5bca4982077b47d9bfd1f1b22179113a/users/8f5292aec821483287e5965190ed6b0d/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:45.179766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caad186-eb34-4888-a3be-05236944b78d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.226440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4fe9d-3b92-4ae7-8b14-0f63f916299b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.239184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:45.242877 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caad186-eb34-4888-a3be-05236944b78d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.249492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884e5a0-9352-453d-9d67-b3342dc32156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.249492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884e5a0-9352-453d-9d67-b3342dc32156 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.249492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884e5a0-9352-453d-9d67-b3342dc32156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.249492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884e5a0-9352-453d-9d67-b3342dc32156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.249953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884e5a0-9352-453d-9d67-b3342dc32156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.252208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884e5a0-9352-453d-9d67-b3342dc32156 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.263184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 805/1597] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.265253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884e5a0-9352-453d-9d67-b3342dc32156 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.277541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884e5a0-9352-453d-9d67-b3342dc32156 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.283325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd380661-0614-43c7-bcf9-fd6a33d4f5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.283942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd380661-0614-43c7-bcf9-fd6a33d4f5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.284217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd380661-0614-43c7-bcf9-fd6a33d4f5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.284487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd380661-0614-43c7-bcf9-fd6a33d4f5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.285271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd380661-0614-43c7-bcf9-fd6a33d4f5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.286999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd380661-0614-43c7-bcf9-fd6a33d4f5eb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.298380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 806/1598] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.299166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd380661-0614-43c7-bcf9-fd6a33d4f5eb admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.307071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc802-3ac3-4a11-b95f-8520f60dd91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.307612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc802-3ac3-4a11-b95f-8520f60dd91a admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.307897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc802-3ac3-4a11-b95f-8520f60dd91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.308451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc802-3ac3-4a11-b95f-8520f60dd91a admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.309191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bc802-3ac3-4a11-b95f-8520f60dd91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.310501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd380661-0614-43c7-bcf9-fd6a33d4f5eb admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.310846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bc802-3ac3-4a11-b95f-8520f60dd91a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.316744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de19d-e349-4ac0-b854-190cab9990f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.319850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de19d-e349-4ac0-b854-190cab9990f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.321010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de19d-e349-4ac0-b854-190cab9990f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.321404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de19d-e349-4ac0-b854-190cab9990f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.322881 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702de19d-e349-4ac0-b854-190cab9990f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.323836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 793/1599] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.324994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702de19d-e349-4ac0-b854-190cab9990f9 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.329930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc802-3ac3-4a11-b95f-8520f60dd91a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.343888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc802-3ac3-4a11-b95f-8520f60dd91a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.345818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 807/1600] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:45.347167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab277-bd64-430a-8fc4-b97d33c956b1 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.347516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab277-bd64-430a-8fc4-b97d33c956b1 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.347858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bab277-bd64-430a-8fc4-b97d33c956b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.349246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f049-c64c-4ee5-bdfb-db3667b2a987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.349944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f049-c64c-4ee5-bdfb-db3667b2a987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.350224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f049-c64c-4ee5-bdfb-db3667b2a987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.350555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f049-c64c-4ee5-bdfb-db3667b2a987 admin admin] PATH_INFO: `/v3/projects/6e85dac8375240e2bd295137ec2ecb3a/users/0948fb44ec754d3f9166ea8fc0e16608/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.366515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247f049-c64c-4ee5-bdfb-db3667b2a987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e85dac8375240e2bd295137ec2ecb3a, user_id=0948fb44ec754d3f9166ea8fc0e16608, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.368195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f9bab277-bd64-430a-8fc4-b97d33c956b1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:45.369638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f9bab277-bd64-430a-8fc4-b97d33c956b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:45.370012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247f049-c64c-4ee5-bdfb-db3667b2a987 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.380717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 808/1601] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:45.380717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b8bb-0073-4f58-b238-6d2846d41729 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.380717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b8bb-0073-4f58-b238-6d2846d41729 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.380717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8b8bb-0073-4f58-b238-6d2846d41729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.393381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 794/1602] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:45 2022] PUT /identity/v3/projects/6e85dac8375240e2bd295137ec2ecb3a/users/0948fb44ec754d3f9166ea8fc0e16608/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:45.393381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f049-c64c-4ee5-bdfb-db3667b2a987 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.395064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:45.418342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ddf8b8bb-0073-4f58-b238-6d2846d41729 None None] MFA Rules not processed for user `8f5292aec821483287e5965190ed6b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:45.419663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ddf8b8bb-0073-4f58-b238-6d2846d41729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:45.472134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f049-c64c-4ee5-bdfb-db3667b2a987 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.485145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c449f7-5c4f-45c7-93c4-fef0322f13c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.486408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c449f7-5c4f-45c7-93c4-fef0322f13c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.486691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c449f7-5c4f-45c7-93c4-fef0322f13c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.486965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c449f7-5c4f-45c7-93c4-fef0322f13c5 admin admin] PATH_INFO: `/v3/projects/2dfffc86a08d462c8e471a909f56b3c3/users/7be58892888f468d9caaeec9f02c5fa2/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.507021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c449f7-5c4f-45c7-93c4-fef0322f13c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfffc86a08d462c8e471a909f56b3c3, user_id=7be58892888f468d9caaeec9f02c5fa2, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.510000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c449f7-5c4f-45c7-93c4-fef0322f13c5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.517588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 809/1603] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:45.519268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8b8bb-0073-4f58-b238-6d2846d41729 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.531456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8b8bb-0073-4f58-b238-6d2846d41729 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.536879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 795/1604] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:45 2022] PUT /identity/v3/projects/2dfffc86a08d462c8e471a909f56b3c3/users/7be58892888f468d9caaeec9f02c5fa2/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:45.536879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c449f7-5c4f-45c7-93c4-fef0322f13c5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.597422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b686203-e28f-4dd8-8c0f-ea1292afefb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.598159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b686203-e28f-4dd8-8c0f-ea1292afefb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.598446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b686203-e28f-4dd8-8c0f-ea1292afefb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.598723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b686203-e28f-4dd8-8c0f-ea1292afefb1 admin admin] PATH_INFO: `/v3/projects/1deeaaaa79ff42cc9151340c26a22346/users/f1c06a3ac55e4813ab640020e38849da/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.615788 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b686203-e28f-4dd8-8c0f-ea1292afefb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1deeaaaa79ff42cc9151340c26a22346, user_id=f1c06a3ac55e4813ab640020e38849da, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.618809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b686203-e28f-4dd8-8c0f-ea1292afefb1 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.621777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c449f7-5c4f-45c7-93c4-fef0322f13c5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.627367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d5e3-2a56-40fe-9c09-18c564237534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.628106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d5e3-2a56-40fe-9c09-18c564237534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.628458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d5e3-2a56-40fe-9c09-18c564237534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.628752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d5e3-2a56-40fe-9c09-18c564237534 admin admin] PATH_INFO: `/v3/projects/faa2563911994111ae9071f7f8b03515/users/e695255f08444f638c9263b069d62852/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.634012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 810/1605] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:45 2022] PUT /identity/v3/projects/1deeaaaa79ff42cc9151340c26a22346/users/f1c06a3ac55e4813ab640020e38849da/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:45.635017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b686203-e28f-4dd8-8c0f-ea1292afefb1 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.642882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:45.650369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d5e3-2a56-40fe-9c09-18c564237534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa2563911994111ae9071f7f8b03515, user_id=e695255f08444f638c9263b069d62852, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.653534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d5e3-2a56-40fe-9c09-18c564237534 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.671380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 796/1606] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:45 2022] PUT /identity/v3/projects/faa2563911994111ae9071f7f8b03515/users/e695255f08444f638c9263b069d62852/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:45.673009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d5e3-2a56-40fe-9c09-18c564237534 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.714778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b686203-e28f-4dd8-8c0f-ea1292afefb1 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.737969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:45.750014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d5e3-2a56-40fe-9c09-18c564237534 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:45.754154 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6637581-ad99-4910-abae-f0831d6cb478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.754892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6637581-ad99-4910-abae-f0831d6cb478 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.755231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6637581-ad99-4910-abae-f0831d6cb478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.755574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6637581-ad99-4910-abae-f0831d6cb478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.793929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163365a-d670-4f6a-9a01-a1d9a5f490a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:45.794765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163365a-d670-4f6a-9a01-a1d9a5f490a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.795212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163365a-d670-4f6a-9a01-a1d9a5f490a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.795499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163365a-d670-4f6a-9a01-a1d9a5f490a2 admin admin] PATH_INFO: `/v3/projects/5a1acca3f6294416849f02a641360cef/users/4ed5c2cd31af417a928cec6a00759c53/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.812746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163365a-d670-4f6a-9a01-a1d9a5f490a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1acca3f6294416849f02a641360cef, user_id=4ed5c2cd31af417a928cec6a00759c53, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.815591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163365a-d670-4f6a-9a01-a1d9a5f490a2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.828282 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6637581-ad99-4910-abae-f0831d6cb478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:45.830082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6637581-ad99-4910-abae-f0831d6cb478 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:45.842430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 797/1607] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:45.844012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c492f8-f7fb-4d6f-be0f-afffc4095172 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:45.844256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c492f8-f7fb-4d6f-be0f-afffc4095172 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:45.844592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c492f8-f7fb-4d6f-be0f-afffc4095172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:45.856115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 811/1608] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:45 2022] PUT /identity/v3/projects/5a1acca3f6294416849f02a641360cef/users/4ed5c2cd31af417a928cec6a00759c53/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:45.857098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163365a-d670-4f6a-9a01-a1d9a5f490a2 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:45.892035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f8c492f8-f7fb-4d6f-be0f-afffc4095172 None None] MFA Rules not processed for user `0948fb44ec754d3f9166ea8fc0e16608`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:45.894558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f8c492f8-f7fb-4d6f-be0f-afffc4095172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:45.995484 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163365a-d670-4f6a-9a01-a1d9a5f490a2 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:46.000963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 798/1609] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:46.002627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a16e2b-bcda-4471-b30b-7779fa007f77 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.002906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a16e2b-bcda-4471-b30b-7779fa007f77 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.003175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a16e2b-bcda-4471-b30b-7779fa007f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.009538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811955d-ce1a-4109-b783-de1fec42d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:46.010589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811955d-ce1a-4109-b783-de1fec42d80c admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.010589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811955d-ce1a-4109-b783-de1fec42d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.010745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811955d-ce1a-4109-b783-de1fec42d80c admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.011355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811955d-ce1a-4109-b783-de1fec42d80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:46.017585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811955d-ce1a-4109-b783-de1fec42d80c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:46.033520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a0a16e2b-bcda-4471-b30b-7779fa007f77 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:46.034944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a0a16e2b-bcda-4471-b30b-7779fa007f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:46.050190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 799/1610] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:46.050190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f6028-7c54-4952-a754-1d6d10f759ca None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.050190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f6028-7c54-4952-a754-1d6d10f759ca None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.050190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f6028-7c54-4952-a754-1d6d10f759ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.073435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 812/1611] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:45 2022] POST /identity/v3/projects => generated 371 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:46.075442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30be8a1-9658-4847-bffc-684f3381f810 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.076423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30be8a1-9658-4847-bffc-684f3381f810 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.076927 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30be8a1-9658-4847-bffc-684f3381f810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.096185 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-703f6028-7c54-4952-a754-1d6d10f759ca None None] MFA Rules not processed for user `f1c06a3ac55e4813ab640020e38849da`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:46.097288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-703f6028-7c54-4952-a754-1d6d10f759ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:46.115554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:46.124708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e30be8a1-9658-4847-bffc-684f3381f810 None None] MFA Rules not processed for user `e695255f08444f638c9263b069d62852`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:46.127330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e30be8a1-9658-4847-bffc-684f3381f810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:46.204321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 813/1612] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:46.205713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e506562-ae55-4adc-99ba-3f4002c99b59 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.206070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e506562-ae55-4adc-99ba-3f4002c99b59 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.206428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e506562-ae55-4adc-99ba-3f4002c99b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.218111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 800/1613] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:46.219337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f6028-7c54-4952-a754-1d6d10f759ca None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:46.257627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-1e506562-ae55-4adc-99ba-3f4002c99b59 None None] MFA Rules not processed for user `4ed5c2cd31af417a928cec6a00759c53`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:46.259356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1e506562-ae55-4adc-99ba-3f4002c99b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:46.273070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:46.358821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 814/1614] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:46.359774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e506562-ae55-4adc-99ba-3f4002c99b59 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:46.376182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f6028-7c54-4952-a754-1d6d10f759ca None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:46.403622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a0922-5fab-4add-8c6e-c9cb433c9b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:46.405235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a0922-5fab-4add-8c6e-c9cb433c9b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.405548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a0922-5fab-4add-8c6e-c9cb433c9b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.405826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a0922-5fab-4add-8c6e-c9cb433c9b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.406514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a0922-5fab-4add-8c6e-c9cb433c9b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:46.408452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a0922-5fab-4add-8c6e-c9cb433c9b56 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:46.478328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e506562-ae55-4adc-99ba-3f4002c99b59 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:46.494772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 801/1615] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/projects => generated 387 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:46.496292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81ab6-81fc-4606-9265-0ea2c2d23564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:46.497809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a0922-5fab-4add-8c6e-c9cb433c9b56 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:46.498634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81ab6-81fc-4606-9265-0ea2c2d23564 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.499160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81ab6-81fc-4606-9265-0ea2c2d23564 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.501159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff81ab6-81fc-4606-9265-0ea2c2d23564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.523383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff81ab6-81fc-4606-9265-0ea2c2d23564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:46.529393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff81ab6-81fc-4606-9265-0ea2c2d23564 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:46.560578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 815/1616] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:46.563883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81ab6-81fc-4606-9265-0ea2c2d23564 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:46.589180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff81ab6-81fc-4606-9265-0ea2c2d23564 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:46.626725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a0922-5fab-4add-8c6e-c9cb433c9b56 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:46.639811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610288e-f712-4811-8ab4-2562e7935eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:46.640740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610288e-f712-4811-8ab4-2562e7935eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.641118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610288e-f712-4811-8ab4-2562e7935eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.641434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610288e-f712-4811-8ab4-2562e7935eaa admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.642629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610288e-f712-4811-8ab4-2562e7935eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:46.646704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610288e-f712-4811-8ab4-2562e7935eaa admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:46.658902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515b5d-ab1d-4837-9411-2c2cb0c9068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:46.659758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515b5d-ab1d-4837-9411-2c2cb0c9068e admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.659917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515b5d-ab1d-4837-9411-2c2cb0c9068e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.660301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf515b5d-ab1d-4837-9411-2c2cb0c9068e admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.661141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf515b5d-ab1d-4837-9411-2c2cb0c9068e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:46.663191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf515b5d-ab1d-4837-9411-2c2cb0c9068e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:46.690687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 802/1617] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:46.691561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85aff-5aa4-4dd2-951d-f6ab19b4764a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.691850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85aff-5aa4-4dd2-951d-f6ab19b4764a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.693141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85aff-5aa4-4dd2-951d-f6ab19b4764a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.693996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 803/1618] 10.222.0.69 () {54 vars in 962 bytes} [Thu Aug 4 02:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:35:46.695183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112321-4d2d-4a62-b4d6-7538ab6cb854 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.696905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112321-4d2d-4a62-b4d6-7538ab6cb854 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.697189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22112321-4d2d-4a62-b4d6-7538ab6cb854 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.698567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 804/1619] 10.222.0.69 () {54 vars in 962 bytes} [Thu Aug 4 02:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:35:46.699569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22112321-4d2d-4a62-b4d6-7538ab6cb854 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:46.710209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 816/1620] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/projects => generated 405 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:46.714699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22112321-4d2d-4a62-b4d6-7538ab6cb854 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:46.716623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515b5d-ab1d-4837-9411-2c2cb0c9068e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:46.775517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:46.776887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:46.803778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf515b5d-ab1d-4837-9411-2c2cb0c9068e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:46.812076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4da278-d1ea-40d0-b068-b3e5df606cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:46.813361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da278-d1ea-40d0-b068-b3e5df606cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.813361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da278-d1ea-40d0-b068-b3e5df606cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.813573 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4da278-d1ea-40d0-b068-b3e5df606cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.814250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4da278-d1ea-40d0-b068-b3e5df606cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:46.815916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4da278-d1ea-40d0-b068-b3e5df606cb8 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:46.828757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 817/1621] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:46.830727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae16556-8c1a-403d-bce1-fd6ed6c0af86 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.831026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae16556-8c1a-403d-bce1-fd6ed6c0af86 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.831310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae16556-8c1a-403d-bce1-fd6ed6c0af86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.847166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965609e9-6ea2-4b57-83dd-b17a6c2f1eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:46.847875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965609e9-6ea2-4b57-83dd-b17a6c2f1eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.848161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965609e9-6ea2-4b57-83dd-b17a6c2f1eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.848437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965609e9-6ea2-4b57-83dd-b17a6c2f1eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.849163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965609e9-6ea2-4b57-83dd-b17a6c2f1eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:46.851716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965609e9-6ea2-4b57-83dd-b17a6c2f1eb7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:46.884198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9ae16556-8c1a-403d-bce1-fd6ed6c0af86 None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:46.885682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9ae16556-8c1a-403d-bce1-fd6ed6c0af86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:46.914102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 805/1622] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:46.914102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d52ca5-02f1-4bf4-b243-202ab7e11603 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:46.914102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d52ca5-02f1-4bf4-b243-202ab7e11603 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:46.914102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d52ca5-02f1-4bf4-b243-202ab7e11603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:46.970911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-41d52ca5-02f1-4bf4-b243-202ab7e11603 None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:46.972140 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-41d52ca5-02f1-4bf4-b243-202ab7e11603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:46.981059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 818/1623] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:46.982147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae16556-8c1a-403d-bce1-fd6ed6c0af86 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:46.989768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 806/1624] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:46.990860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d52ca5-02f1-4bf4-b243-202ab7e11603 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:47.005183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d52ca5-02f1-4bf4-b243-202ab7e11603 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.005767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae16556-8c1a-403d-bce1-fd6ed6c0af86 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.011544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8ab4c-677c-42f6-ac26-ff6f52636a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.012907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8ab4c-677c-42f6-ac26-ff6f52636a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.013264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8ab4c-677c-42f6-ac26-ff6f52636a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.013780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8ab4c-677c-42f6-ac26-ff6f52636a9a admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.014396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71f54d-b83c-4d2a-ba6e-770f14df9f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.014620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8ab4c-677c-42f6-ac26-ff6f52636a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.015290 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71f54d-b83c-4d2a-ba6e-770f14df9f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.015634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71f54d-b83c-4d2a-ba6e-770f14df9f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.015974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71f54d-b83c-4d2a-ba6e-770f14df9f1e admin admin] PATH_INFO: `/v3/projects/58c890a987eb47539aa30d161993db11/users/69101ba515d54009a44b0d5e7171c006/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.016861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8ab4c-677c-42f6-ac26-ff6f52636a9a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.050420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 819/1625] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:46 2022] POST /identity/v3/users => generated 309 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:47.053625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71f54d-b83c-4d2a-ba6e-770f14df9f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c890a987eb47539aa30d161993db11, user_id=69101ba515d54009a44b0d5e7171c006, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.054598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8ab4c-677c-42f6-ac26-ff6f52636a9a admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:47.058043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71f54d-b83c-4d2a-ba6e-770f14df9f1e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.066293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8ab4c-677c-42f6-ac26-ff6f52636a9a admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.075088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975601-4326-4184-93e9-d2fb0364abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.075817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975601-4326-4184-93e9-d2fb0364abd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.078168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975601-4326-4184-93e9-d2fb0364abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.078470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd975601-4326-4184-93e9-d2fb0364abd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.080866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd975601-4326-4184-93e9-d2fb0364abd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.084965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd975601-4326-4184-93e9-d2fb0364abd5 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.092054 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 807/1626] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:46 2022] PUT /identity/v3/projects/58c890a987eb47539aa30d161993db11/users/69101ba515d54009a44b0d5e7171c006/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:47.092942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71f54d-b83c-4d2a-ba6e-770f14df9f1e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:47.119271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 820/1627] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:47.119271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975601-4326-4184-93e9-d2fb0364abd5 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:47.136529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd975601-4326-4184-93e9-d2fb0364abd5 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.322135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71f54d-b83c-4d2a-ba6e-770f14df9f1e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.322135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181e5fe-9623-4c99-8d0a-123be13193c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.322135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181e5fe-9623-4c99-8d0a-123be13193c5 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.322135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181e5fe-9623-4c99-8d0a-123be13193c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.334241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181e5fe-9623-4c99-8d0a-123be13193c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.358671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892951-943b-4425-a40a-976e5a66eef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.359657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892951-943b-4425-a40a-976e5a66eef6 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.360187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181e5fe-9623-4c99-8d0a-123be13193c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.360696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892951-943b-4425-a40a-976e5a66eef6 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.362108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892951-943b-4425-a40a-976e5a66eef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.362702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181e5fe-9623-4c99-8d0a-123be13193c5 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.385917 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 808/1628] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:47.401457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181e5fe-9623-4c99-8d0a-123be13193c5 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:47.415112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:47.473397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:47.497266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47892951-943b-4425-a40a-976e5a66eef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.498974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47892951-943b-4425-a40a-976e5a66eef6 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.523123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 821/1629] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:47.533731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892951-943b-4425-a40a-976e5a66eef6 service nova] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:47.588526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181e5fe-9623-4c99-8d0a-123be13193c5 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.598943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972fad6-8161-4187-831d-a2616b1480d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.599571 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972fad6-8161-4187-831d-a2616b1480d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.599851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972fad6-8161-4187-831d-a2616b1480d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.600126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972fad6-8161-4187-831d-a2616b1480d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.605349 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972fad6-8161-4187-831d-a2616b1480d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.607605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972fad6-8161-4187-831d-a2616b1480d8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.636205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 809/1630] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:47.639919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972fad6-8161-4187-831d-a2616b1480d8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:47.662012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972fad6-8161-4187-831d-a2616b1480d8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.674003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cac6d-111c-4d12-8910-fcf164cdfe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.674693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cac6d-111c-4d12-8910-fcf164cdfe14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.674969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cac6d-111c-4d12-8910-fcf164cdfe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.678872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cac6d-111c-4d12-8910-fcf164cdfe14 admin admin] PATH_INFO: `/v3/projects/b2074feb7f1c403ea7901aeff9659a6c/users/ebcf736e7ad649d3a099f4b4bbedd717/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.708541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cac6d-111c-4d12-8910-fcf164cdfe14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2074feb7f1c403ea7901aeff9659a6c, user_id=ebcf736e7ad649d3a099f4b4bbedd717, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.714542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cac6d-111c-4d12-8910-fcf164cdfe14 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.736668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892951-943b-4425-a40a-976e5a66eef6 service nova] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.741903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef5fa4-fdb3-436b-b5f6-e5a00680b805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.742604 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef5fa4-fdb3-436b-b5f6-e5a00680b805 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.742915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef5fa4-fdb3-436b-b5f6-e5a00680b805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.743194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef5fa4-fdb3-436b-b5f6-e5a00680b805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.743953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef5fa4-fdb3-436b-b5f6-e5a00680b805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.746752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef5fa4-fdb3-436b-b5f6-e5a00680b805 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.761317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 822/1631] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:47.761317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef5fa4-fdb3-436b-b5f6-e5a00680b805 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:47.768278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 810/1632] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:47 2022] PUT /identity/v3/projects/b2074feb7f1c403ea7901aeff9659a6c/users/ebcf736e7ad649d3a099f4b4bbedd717/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:47.769470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cac6d-111c-4d12-8910-fcf164cdfe14 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:47.773280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef5fa4-fdb3-436b-b5f6-e5a00680b805 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.879611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3e54d-302d-41db-9777-b5fde4f3266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.880299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3e54d-302d-41db-9777-b5fde4f3266b admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.880596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3e54d-302d-41db-9777-b5fde4f3266b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.882429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3e54d-302d-41db-9777-b5fde4f3266b admin admin] PATH_INFO: `/v3/projects/d2250ed9ddaf446ca3417db52b802da8/users/7527c5bfcde644d08e13a11c07cac70d/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.949400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3e54d-302d-41db-9777-b5fde4f3266b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2250ed9ddaf446ca3417db52b802da8, user_id=7527c5bfcde644d08e13a11c07cac70d, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.955372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3e54d-302d-41db-9777-b5fde4f3266b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.957267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cac6d-111c-4d12-8910-fcf164cdfe14 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:47.967326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90982db3-b418-418b-81c1-1b661d7d7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:47.968105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90982db3-b418-418b-81c1-1b661d7d7a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:47.968393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90982db3-b418-418b-81c1-1b661d7d7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:47.968671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90982db3-b418-418b-81c1-1b661d7d7a31 admin admin] PATH_INFO: `/v3/projects/58c890a987eb47539aa30d161993db11/users/69101ba515d54009a44b0d5e7171c006/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:47.971057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90982db3-b418-418b-81c1-1b661d7d7a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c890a987eb47539aa30d161993db11, user_id=69101ba515d54009a44b0d5e7171c006, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:47.974251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90982db3-b418-418b-81c1-1b661d7d7a31 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:47.990938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 823/1633] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:47 2022] PUT /identity/v3/projects/d2250ed9ddaf446ca3417db52b802da8/users/7527c5bfcde644d08e13a11c07cac70d/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:47.991867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3e54d-302d-41db-9777-b5fde4f3266b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:48.011965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 811/1634] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:47 2022] PUT /identity/v3/projects/58c890a987eb47539aa30d161993db11/users/69101ba515d54009a44b0d5e7171c006/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:48.013482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c961f-deb4-47d2-b59c-4489e3423a9a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.014844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c961f-deb4-47d2-b59c-4489e3423a9a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.014844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c961f-deb4-47d2-b59c-4489e3423a9a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.019469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 812/1635] 10.222.0.69 () {54 vars in 912 bytes} [Thu Aug 4 02:35:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:35:48.021779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c961f-deb4-47d2-b59c-4489e3423a9a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:48.093563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:48.151292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3e54d-302d-41db-9777-b5fde4f3266b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:48.205256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c961f-deb4-47d2-b59c-4489e3423a9a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:48.226311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb359-2bf1-42fb-b72c-c014948337e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:48.226839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb359-2bf1-42fb-b72c-c014948337e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.227130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb359-2bf1-42fb-b72c-c014948337e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.227405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb359-2bf1-42fb-b72c-c014948337e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.228175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb359-2bf1-42fb-b72c-c014948337e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:48.237229 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb359-2bf1-42fb-b72c-c014948337e7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:48.273922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 813/1636] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:48.287302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a1f86-3ac9-4da3-b440-6cfd896be809 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.287654 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a1f86-3ac9-4da3-b440-6cfd896be809 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.287939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a1f86-3ac9-4da3-b440-6cfd896be809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.314773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11083-a4b4-4535-862e-883e0abe8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:48.315412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11083-a4b4-4535-862e-883e0abe8d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.315697 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11083-a4b4-4535-862e-883e0abe8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.316576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11083-a4b4-4535-862e-883e0abe8d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.317297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff11083-a4b4-4535-862e-883e0abe8d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:48.319475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff11083-a4b4-4535-862e-883e0abe8d7f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:48.339587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 824/1637] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:48.341938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25838dfe-7c06-406b-9769-fb8f56eee595 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.342229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25838dfe-7c06-406b-9769-fb8f56eee595 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.343612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25838dfe-7c06-406b-9769-fb8f56eee595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.363583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f29a1f86-3ac9-4da3-b440-6cfd896be809 None None] MFA Rules not processed for user `69101ba515d54009a44b0d5e7171c006`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:48.368497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-25838dfe-7c06-406b-9769-fb8f56eee595 None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:48.370092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f29a1f86-3ac9-4da3-b440-6cfd896be809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:48.370247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-25838dfe-7c06-406b-9769-fb8f56eee595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:48.401529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:48.544036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 825/1638] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:35:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:48.544976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25838dfe-7c06-406b-9769-fb8f56eee595 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:48.561292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 814/1639] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:48.562795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25838dfe-7c06-406b-9769-fb8f56eee595 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:48.562906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32df7-0c55-45f5-b872-0e266c73f20b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.563198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32df7-0c55-45f5-b872-0e266c73f20b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.563289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32df7-0c55-45f5-b872-0e266c73f20b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.569359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb56cae-de58-41f4-bc42-cf88f6668aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:48.570403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb56cae-de58-41f4-bc42-cf88f6668aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.570878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb56cae-de58-41f4-bc42-cf88f6668aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.571235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb56cae-de58-41f4-bc42-cf88f6668aea admin admin] PATH_INFO: `/v3/projects/d2250ed9ddaf446ca3417db52b802da8/users/7527c5bfcde644d08e13a11c07cac70d/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.575101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb56cae-de58-41f4-bc42-cf88f6668aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2250ed9ddaf446ca3417db52b802da8, user_id=7527c5bfcde644d08e13a11c07cac70d, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:48.575303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 815/1640] 10.222.0.69 () {54 vars in 912 bytes} [Thu Aug 4 02:35:48 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:35:48.576405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32df7-0c55-45f5-b872-0e266c73f20b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:48.579492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb56cae-de58-41f4-bc42-cf88f6668aea admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:48.602185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 826/1641] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:48 2022] PUT /identity/v3/projects/d2250ed9ddaf446ca3417db52b802da8/users/7527c5bfcde644d08e13a11c07cac70d/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:48.602185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb56cae-de58-41f4-bc42-cf88f6668aea admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:48.612923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32df7-0c55-45f5-b872-0e266c73f20b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:48.710368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb56cae-de58-41f4-bc42-cf88f6668aea admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:48.719734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd30e0-6713-46b4-98e5-2ee864b5b872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:48.720610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd30e0-6713-46b4-98e5-2ee864b5b872 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.721116 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd30e0-6713-46b4-98e5-2ee864b5b872 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.721568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd30e0-6713-46b4-98e5-2ee864b5b872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.760080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f83dbd-aa63-4737-9384-5364063eaac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:48.760737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:48.761135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f83dbd-aa63-4737-9384-5364063eaac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.761135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f83dbd-aa63-4737-9384-5364063eaac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.761293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f83dbd-aa63-4737-9384-5364063eaac1 admin admin] PATH_INFO: `/v3/projects/b2074feb7f1c403ea7901aeff9659a6c/users/ebcf736e7ad649d3a099f4b4bbedd717/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.765897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f83dbd-aa63-4737-9384-5364063eaac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2074feb7f1c403ea7901aeff9659a6c, user_id=ebcf736e7ad649d3a099f4b4bbedd717, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:48.768653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f83dbd-aa63-4737-9384-5364063eaac1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:48.796305 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 816/1642] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:48 2022] PUT /identity/v3/projects/b2074feb7f1c403ea7901aeff9659a6c/users/ebcf736e7ad649d3a099f4b4bbedd717/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:48.797519 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f83dbd-aa63-4737-9384-5364063eaac1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:48.865264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd30e0-6713-46b4-98e5-2ee864b5b872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:48.867036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd30e0-6713-46b4-98e5-2ee864b5b872 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:48.892568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 827/1643] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:48.897580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427ddb-6059-48c6-939b-4fd07a2162ed None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.897867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427ddb-6059-48c6-939b-4fd07a2162ed None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.898190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427ddb-6059-48c6-939b-4fd07a2162ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.922512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f83dbd-aa63-4737-9384-5364063eaac1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:48.930183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a97aa3-6289-4c66-9242-20f3cd6ca6db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:48.930818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a97aa3-6289-4c66-9242-20f3cd6ca6db service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:48.931259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a97aa3-6289-4c66-9242-20f3cd6ca6db service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:48.931544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a97aa3-6289-4c66-9242-20f3cd6ca6db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:48.937652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ef427ddb-6059-48c6-939b-4fd07a2162ed None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:48.938885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ef427ddb-6059-48c6-939b-4fd07a2162ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:49.062600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:49.072608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a97aa3-6289-4c66-9242-20f3cd6ca6db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:49.075919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a97aa3-6289-4c66-9242-20f3cd6ca6db service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:49.088017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 828/1644] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:35:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:49.098104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74004a-ac9b-4eae-a612-39217d78467d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:49.098532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74004a-ac9b-4eae-a612-39217d78467d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:49.098887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74004a-ac9b-4eae-a612-39217d78467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:49.109697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 817/1645] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:49.116468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318004f-79d9-45a7-80a3-da00e620b952 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:49.119675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318004f-79d9-45a7-80a3-da00e620b952 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:49.119675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318004f-79d9-45a7-80a3-da00e620b952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:49.174401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-dd74004a-ac9b-4eae-a612-39217d78467d None None] MFA Rules not processed for user `7527c5bfcde644d08e13a11c07cac70d`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:49.176989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-dd74004a-ac9b-4eae-a612-39217d78467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:49.186480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4318004f-79d9-45a7-80a3-da00e620b952 None None] MFA Rules not processed for user `ebcf736e7ad649d3a099f4b4bbedd717`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:49.190091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4318004f-79d9-45a7-80a3-da00e620b952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:49.377990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 829/1646] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:49 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:49.379110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74004a-ac9b-4eae-a612-39217d78467d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:49.399240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 818/1647] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:49.410124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74004a-ac9b-4eae-a612-39217d78467d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:49.422109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f954b4-4f19-4bc2-8b9c-a4cf55360daf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:49.422913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f954b4-4f19-4bc2-8b9c-a4cf55360daf service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:49.423333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f954b4-4f19-4bc2-8b9c-a4cf55360daf service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:49.425108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f954b4-4f19-4bc2-8b9c-a4cf55360daf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:49.453567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f954b4-4f19-4bc2-8b9c-a4cf55360daf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:49.455206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f954b4-4f19-4bc2-8b9c-a4cf55360daf service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:49.478099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318004f-79d9-45a7-80a3-da00e620b952 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:49.490486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318004f-79d9-45a7-80a3-da00e620b952 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:49.492838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 830/1648] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:49.503927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ac43-684a-4545-9b0d-5ca1e087b6d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:49.504894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ac43-684a-4545-9b0d-5ca1e087b6d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:49.505411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ac43-684a-4545-9b0d-5ca1e087b6d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:49.505843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ac43-684a-4545-9b0d-5ca1e087b6d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:49.631420 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6ac43-684a-4545-9b0d-5ca1e087b6d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:49.635450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6ac43-684a-4545-9b0d-5ca1e087b6d5 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:49.661289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 819/1649] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:35:50.156993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f954b4-4f19-4bc2-8b9c-a4cf55360daf service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:50.174174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f954b4-4f19-4bc2-8b9c-a4cf55360daf service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:50.181050 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d0f23-0f55-4606-9eb7-f2ad969ddc71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:50.182007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0f23-0f55-4606-9eb7-f2ad969ddc71 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:50.182820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0f23-0f55-4606-9eb7-f2ad969ddc71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:50.183251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0f23-0f55-4606-9eb7-f2ad969ddc71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:50.201078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:50.206245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d0f23-0f55-4606-9eb7-f2ad969ddc71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:50.208874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d0f23-0f55-4606-9eb7-f2ad969ddc71 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:50.234636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 831/1650] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:50 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:50.312454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ac43-684a-4545-9b0d-5ca1e087b6d5 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:50.326298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ac43-684a-4545-9b0d-5ca1e087b6d5 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:50.340850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b7faf-d6cc-4b74-bcc9-bfe158745eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:50.342374 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b7faf-d6cc-4b74-bcc9-bfe158745eda service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:50.343783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b7faf-d6cc-4b74-bcc9-bfe158745eda service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:50.345565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b7faf-d6cc-4b74-bcc9-bfe158745eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:50.369459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b7faf-d6cc-4b74-bcc9-bfe158745eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:50.372610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b7faf-d6cc-4b74-bcc9-bfe158745eda service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:50.418275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 820/1651] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:50.446950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d0f23-0f55-4606-9eb7-f2ad969ddc71 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:50.527119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b7faf-d6cc-4b74-bcc9-bfe158745eda service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:50.710677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d0f23-0f55-4606-9eb7-f2ad969ddc71 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:50.728510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b7faf-d6cc-4b74-bcc9-bfe158745eda service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:50.737850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:50.738399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:50.738683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:50.738953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] PATH_INFO: `/v3/users/0948fb44ec754d3f9166ea8fc0e16608` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:50.742013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:50.748628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:50.749759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:50.750781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] PATH_INFO: `/v3/users/e695255f08444f638c9263b069d62852` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:50.755403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e695255f08444f638c9263b069d62852)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:50.757123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0948fb44ec754d3f9166ea8fc0e16608)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:50.758760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:35:50.758760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: warnings.warn(msg) Aug 04 02:35:50.758760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: Aug 04 02:35:50.761363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:50.762393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:50.776683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:50.918988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e695255f08444f638c9263b069d62852'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:50.938075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e695255f08444f638c9263b069d62852'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:50.950511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0948fb44ec754d3f9166ea8fc0e16608'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:50.966032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e695255f08444f638c9263b069d62852'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:50.967691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e695255f08444f638c9263b069d62852'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:50.969947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50754c96-cf5c-40bc-b744-4c7c21ec91b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e695255f08444f638c9263b069d62852'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:50.976592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0948fb44ec754d3f9166ea8fc0e16608'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:51.002242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0948fb44ec754d3f9166ea8fc0e16608'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:51.010020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0948fb44ec754d3f9166ea8fc0e16608'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:51.056743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 821/1652] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:35:50 2022] DELETE /identity/v3/users/e695255f08444f638c9263b069d62852 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:35:51.060734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653fc2b-7156-4886-980a-64bc59a4b1c8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:51.061089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653fc2b-7156-4886-980a-64bc59a4b1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:51.084780 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653fc2b-7156-4886-980a-64bc59a4b1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:51.085054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-32b215e8-b147-4ba7-92bf-4e8108faa0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0948fb44ec754d3f9166ea8fc0e16608'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:51.098432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 832/1653] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:35:50 2022] DELETE /identity/v3/users/0948fb44ec754d3f9166ea8fc0e16608 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:51.102957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87300029-5173-4a2d-8992-fd81ad2ac9f8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:51.103285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87300029-5173-4a2d-8992-fd81ad2ac9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:51.103598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87300029-5173-4a2d-8992-fd81ad2ac9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:51.117845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b653fc2b-7156-4886-980a-64bc59a4b1c8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:51.123292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b653fc2b-7156-4886-980a-64bc59a4b1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:51.172374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-87300029-5173-4a2d-8992-fd81ad2ac9f8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:51.176093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-87300029-5173-4a2d-8992-fd81ad2ac9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:51.278060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 833/1654] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:51.359935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 822/1655] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:51.641371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87300029-5173-4a2d-8992-fd81ad2ac9f8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:51.643306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-87300029-5173-4a2d-8992-fd81ad2ac9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:51.662988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653fc2b-7156-4886-980a-64bc59a4b1c8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:51.664516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b653fc2b-7156-4886-980a-64bc59a4b1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:51.710950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:51.862941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653fc2b-7156-4886-980a-64bc59a4b1c8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:51.875050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad2cea-094e-4f45-8776-9b1efcc6bc9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:51.875763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad2cea-094e-4f45-8776-9b1efcc6bc9a service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:51.876066 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad2cea-094e-4f45-8776-9b1efcc6bc9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:51.876343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad2cea-094e-4f45-8776-9b1efcc6bc9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:51.897791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad2cea-094e-4f45-8776-9b1efcc6bc9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:51.899878 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad2cea-094e-4f45-8776-9b1efcc6bc9a service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:51.927524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 823/1656] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:35:51.928118 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87300029-5173-4a2d-8992-fd81ad2ac9f8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:51.928389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad2cea-094e-4f45-8776-9b1efcc6bc9a service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:51.932644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed5f55-69fb-4c96-822c-ec9796489a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:51.934188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed5f55-69fb-4c96-822c-ec9796489a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:51.934752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed5f55-69fb-4c96-822c-ec9796489a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:51.936211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed5f55-69fb-4c96-822c-ec9796489a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:51.938438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6dad2cea-094e-4f45-8776-9b1efcc6bc9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:51.951184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed5f55-69fb-4c96-822c-ec9796489a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:51.953075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed5f55-69fb-4c96-822c-ec9796489a66 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:51.961043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad2cea-094e-4f45-8776-9b1efcc6bc9a service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:51.970913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 834/1657] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:51.975200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:51.975822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:51.977169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:51.977638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] PATH_INFO: `/v3/users/f1c06a3ac55e4813ab640020e38849da` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:51.982266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c06a3ac55e4813ab640020e38849da)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:51.984368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:52.013303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:52.069793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c06a3ac55e4813ab640020e38849da'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:52.086993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c06a3ac55e4813ab640020e38849da'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:52.101521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c06a3ac55e4813ab640020e38849da'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:52.102554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c06a3ac55e4813ab640020e38849da'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:52.106402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c06a3ac55e4813ab640020e38849da'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:52.132763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 824/1658] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:35:51 2022] DELETE /identity/v3/users/f1c06a3ac55e4813ab640020e38849da => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:52.138750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43befa-459d-4cec-8934-4e42bfe1bd10 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:52.139035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43befa-459d-4cec-8934-4e42bfe1bd10 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:52.139309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43befa-459d-4cec-8934-4e42bfe1bd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:52.161831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ae43befa-459d-4cec-8934-4e42bfe1bd10 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:52.163508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ae43befa-459d-4cec-8934-4e42bfe1bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:52.288870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 835/1659] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:52.310517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:52.312611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:52.449596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd346d61-01fa-4eb3-afe9-2ed93197e716 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:52.456776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9ff28-5afe-4e72-a279-983176be828c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:52.463330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9ff28-5afe-4e72-a279-983176be828c service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:52.463687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9ff28-5afe-4e72-a279-983176be828c service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:52.463905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9ff28-5afe-4e72-a279-983176be828c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:52.485251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9ff28-5afe-4e72-a279-983176be828c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:52.486822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9ff28-5afe-4e72-a279-983176be828c service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:52.515714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 825/1660] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:53.496730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43befa-459d-4cec-8934-4e42bfe1bd10 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:53.498852 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ae43befa-459d-4cec-8934-4e42bfe1bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:53.528227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43befa-459d-4cec-8934-4e42bfe1bd10 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:53.541508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:53.545091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:53.545915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:53.550494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] PATH_INFO: `/v3/projects/faa2563911994111ae9071f7f8b03515` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:53.554249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa2563911994111ae9071f7f8b03515)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:53.556135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: WARNING py.warnings [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 02:35:53.556135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: warnings.warn(msg) Aug 04 02:35:53.556135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: Aug 04 02:35:53.560939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:53.665911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa2563911994111ae9071f7f8b03515', 'request_id': 'req-7680360c-0e3e-4922-8f17-145ab246b25e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:53.680094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa2563911994111ae9071f7f8b03515', 'request_id': 'req-7680360c-0e3e-4922-8f17-145ab246b25e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:53.691253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa2563911994111ae9071f7f8b03515', 'request_id': 'req-7680360c-0e3e-4922-8f17-145ab246b25e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:53.758661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] The token cache is being invalidate because project faa2563911994111ae9071f7f8b03515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:35:53.759015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:53.762863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7680360c-0e3e-4922-8f17-145ab246b25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:53.772421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 836/1661] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:35:53 2022] DELETE /identity/v3/projects/faa2563911994111ae9071f7f8b03515 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:53.774379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7006-47df-4d58-9a3a-e711fb267bbb None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:53.775446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7006-47df-4d58-9a3a-e711fb267bbb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:53.776073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7006-47df-4d58-9a3a-e711fb267bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:53.809315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-130d7006-47df-4d58-9a3a-e711fb267bbb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:53.811813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-130d7006-47df-4d58-9a3a-e711fb267bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:53.874191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf451223-fb0b-46b6-8d16-b9f31f61051f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:53.874796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf451223-fb0b-46b6-8d16-b9f31f61051f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:53.875271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf451223-fb0b-46b6-8d16-b9f31f61051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:53.924903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bf451223-fb0b-46b6-8d16-b9f31f61051f None None] MFA Rules not processed for user `402d29e2c7ce47cfbbb8376fbf85a0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:53.928055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bf451223-fb0b-46b6-8d16-b9f31f61051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:53.951554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 826/1662] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:35:53.959097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47215323-fc13-4ed3-8100-40be6894995a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:53.959557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47215323-fc13-4ed3-8100-40be6894995a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:53.960014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47215323-fc13-4ed3-8100-40be6894995a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:53.988348 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:53.990341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-47215323-fc13-4ed3-8100-40be6894995a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:53.991805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-47215323-fc13-4ed3-8100-40be6894995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:54.002054 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 827/1663] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:35:54.018403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47215323-fc13-4ed3-8100-40be6894995a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.029734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47215323-fc13-4ed3-8100-40be6894995a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.035096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2beab0-ff46-4ca4-8184-d58b22f69445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.035731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2beab0-ff46-4ca4-8184-d58b22f69445 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.036050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2beab0-ff46-4ca4-8184-d58b22f69445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.036324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2beab0-ff46-4ca4-8184-d58b22f69445 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.037538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2beab0-ff46-4ca4-8184-d58b22f69445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:54.037983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2beab0-ff46-4ca4-8184-d58b22f69445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.040990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2beab0-ff46-4ca4-8184-d58b22f69445 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:54.051384 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 837/1664] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:54.065372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043384-afc3-43ab-94e0-fae6843f8d9a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.065567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043384-afc3-43ab-94e0-fae6843f8d9a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.066708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043384-afc3-43ab-94e0-fae6843f8d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.069402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 828/1665] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:54.073359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2beab0-ff46-4ca4-8184-d58b22f69445 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.094760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bb043384-afc3-43ab-94e0-fae6843f8d9a None None] MFA Rules not processed for user `402d29e2c7ce47cfbbb8376fbf85a0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:54.096060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bb043384-afc3-43ab-94e0-fae6843f8d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:54.101596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2beab0-ff46-4ca4-8184-d58b22f69445 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.110328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 838/1666] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:54.112998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f6044-79ee-4487-9237-af43ff7fec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.113907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6044-79ee-4487-9237-af43ff7fec73 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.114191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6044-79ee-4487-9237-af43ff7fec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.114622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6044-79ee-4487-9237-af43ff7fec73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.115597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f6044-79ee-4487-9237-af43ff7fec73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.116366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043384-afc3-43ab-94e0-fae6843f8d9a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.118997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bb043384-afc3-43ab-94e0-fae6843f8d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:54.119118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f6044-79ee-4487-9237-af43ff7fec73 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:54.187893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 829/1667] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:54 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:35:54.192460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f6044-79ee-4487-9237-af43ff7fec73 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.199090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:54.245988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043384-afc3-43ab-94e0-fae6843f8d9a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.314551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f6044-79ee-4487-9237-af43ff7fec73 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.321039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e502d-bc61-4d32-b43d-94492e7df974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.321857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e502d-bc61-4d32-b43d-94492e7df974 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.322142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e502d-bc61-4d32-b43d-94492e7df974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.322419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e502d-bc61-4d32-b43d-94492e7df974 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.323274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e502d-bc61-4d32-b43d-94492e7df974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.326153 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e502d-bc61-4d32-b43d-94492e7df974 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:54.330737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503e7b-2e9f-47c3-83ce-96530e854949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.331454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503e7b-2e9f-47c3-83ce-96530e854949 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.331819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503e7b-2e9f-47c3-83ce-96530e854949 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.332222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98503e7b-2e9f-47c3-83ce-96530e854949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.357291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 830/1668] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:54 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:35:54.361391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e502d-bc61-4d32-b43d-94492e7df974 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.378106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e502d-bc61-4d32-b43d-94492e7df974 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.391021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421aa4-280e-4884-b602-bcdfe7f38637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.392237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421aa4-280e-4884-b602-bcdfe7f38637 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.392534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421aa4-280e-4884-b602-bcdfe7f38637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.392865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421aa4-280e-4884-b602-bcdfe7f38637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.393643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421aa4-280e-4884-b602-bcdfe7f38637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.395370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421aa4-280e-4884-b602-bcdfe7f38637 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:54.411065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 831/1669] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:54.415148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421aa4-280e-4884-b602-bcdfe7f38637 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.431481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421aa4-280e-4884-b602-bcdfe7f38637 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.431835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98503e7b-2e9f-47c3-83ce-96530e854949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.433925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98503e7b-2e9f-47c3-83ce-96530e854949 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:54.438307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a8131-15f1-410c-961a-898fd8a7b802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.438940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a8131-15f1-410c-961a-898fd8a7b802 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.439550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a8131-15f1-410c-961a-898fd8a7b802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.439832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a8131-15f1-410c-961a-898fd8a7b802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.443477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a8131-15f1-410c-961a-898fd8a7b802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.443767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:54.446465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 839/1670] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:35:54.461142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a8131-15f1-410c-961a-898fd8a7b802 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:54.481992 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503e7b-2e9f-47c3-83ce-96530e854949 service nova] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.486605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 832/1671] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:54.487039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-98503e7b-2e9f-47c3-83ce-96530e854949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:54.487675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a8131-15f1-410c-961a-898fd8a7b802 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.510447 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a8131-15f1-410c-961a-898fd8a7b802 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.517726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98503e7b-2e9f-47c3-83ce-96530e854949 service nova] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.524614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.525119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7bf2b-82ba-4242-8b42-ca5f1caf6525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.525972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.527708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.528010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7bf2b-82ba-4242-8b42-ca5f1caf6525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.528107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] PATH_INFO: `/v3/projects/6e85dac8375240e2bd295137ec2ecb3a` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.528546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7bf2b-82ba-4242-8b42-ca5f1caf6525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.530136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e85dac8375240e2bd295137ec2ecb3a)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.530326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7bf2b-82ba-4242-8b42-ca5f1caf6525 admin admin] PATH_INFO: `/v3/projects/b135741af711474f93e5f06e894ea8b6/users/b9044ae1b4c94008ac8c63a84fa1035c/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.533550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:54.560046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7bf2b-82ba-4242-8b42-ca5f1caf6525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b135741af711474f93e5f06e894ea8b6, user_id=b9044ae1b4c94008ac8c63a84fa1035c, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.563396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7bf2b-82ba-4242-8b42-ca5f1caf6525 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:54.602277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 833/1672] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:54 2022] PUT /identity/v3/projects/b135741af711474f93e5f06e894ea8b6/users/b9044ae1b4c94008ac8c63a84fa1035c/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:54.625648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47574311-e2e1-4dd2-b200-33986405825a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.625940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47574311-e2e1-4dd2-b200-33986405825a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.626222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47574311-e2e1-4dd2-b200-33986405825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.684572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e85dac8375240e2bd295137ec2ecb3a', 'request_id': 'req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:54.700537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-47574311-e2e1-4dd2-b200-33986405825a None None] MFA Rules not processed for user `b9044ae1b4c94008ac8c63a84fa1035c`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:54.702618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-47574311-e2e1-4dd2-b200-33986405825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:54.713895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e85dac8375240e2bd295137ec2ecb3a', 'request_id': 'req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:54.726490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e85dac8375240e2bd295137ec2ecb3a', 'request_id': 'req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:54.748396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] The token cache is being invalidate because project 6e85dac8375240e2bd295137ec2ecb3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:35:54.748886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:54.750968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:54.754434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 840/1673] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:35:54 2022] DELETE /identity/v3/projects/6e85dac8375240e2bd295137ec2ecb3a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:35:54.755819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.760165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:54.846726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 834/1674] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:54.855608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47574311-e2e1-4dd2-b200-33986405825a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:54.861673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-47574311-e2e1-4dd2-b200-33986405825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:54.933825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee10d-0aa1-4de2-aede-2e4d49aa6bb2 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.935916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:54.948650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.950153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.950545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.950923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] PATH_INFO: `/v3/users/4ed5c2cd31af417a928cec6a00759c53` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.954150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed5c2cd31af417a928cec6a00759c53)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.956652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:54.977560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47574311-e2e1-4dd2-b200-33986405825a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:54.983827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:54.985828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:54.986320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:54.986767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] PATH_INFO: `/v3/users/ebcf736e7ad649d3a099f4b4bbedd717` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:54.988477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebcf736e7ad649d3a099f4b4bbedd717)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:54.992178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:55.084439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed5c2cd31af417a928cec6a00759c53'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.100990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebcf736e7ad649d3a099f4b4bbedd717'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.107243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed5c2cd31af417a928cec6a00759c53'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.126824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed5c2cd31af417a928cec6a00759c53'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.127956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed5c2cd31af417a928cec6a00759c53'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.138397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebcf736e7ad649d3a099f4b4bbedd717'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.151018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed5c2cd31af417a928cec6a00759c53'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.154819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebcf736e7ad649d3a099f4b4bbedd717'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.156382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebcf736e7ad649d3a099f4b4bbedd717'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.157370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f91a0f49-6555-45df-94bc-beb6ce61bb2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebcf736e7ad649d3a099f4b4bbedd717'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.165153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 841/1675] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:35:54 2022] DELETE /identity/v3/users/4ed5c2cd31af417a928cec6a00759c53 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:55.166126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:55.169436 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:55.189021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:55.212913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 835/1676] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:35:54 2022] DELETE /identity/v3/users/ebcf736e7ad649d3a099f4b4bbedd717 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:55.216323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7bbb-de99-4846-b4e7-649f08d1a8bd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:55.216620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7bbb-de99-4846-b4e7-649f08d1a8bd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:55.216918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7bbb-de99-4846-b4e7-649f08d1a8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:55.287661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a0bf7bbb-de99-4846-b4e7-649f08d1a8bd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:55.288971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a0bf7bbb-de99-4846-b4e7-649f08d1a8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:55.364614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ba2c6-3c83-4159-9a35-79ed2d877092 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:55.478257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 836/1677] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:55.484295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bde1d-8e8e-4861-b7af-ba4c04e6667d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:55.484593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bde1d-8e8e-4861-b7af-ba4c04e6667d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:55.484874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bde1d-8e8e-4861-b7af-ba4c04e6667d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:55.495102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 837/1678] 10.222.0.69 () {54 vars in 912 bytes} [Thu Aug 4 02:35:55 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:35:55.496649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bde1d-8e8e-4861-b7af-ba4c04e6667d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:55.503010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f63bde1d-8e8e-4861-b7af-ba4c04e6667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:55.543798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bde1d-8e8e-4861-b7af-ba4c04e6667d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:55.555663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:55.556371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:55.556655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:55.556931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] PATH_INFO: `/v3/projects/1deeaaaa79ff42cc9151340c26a22346` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:55.562183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1deeaaaa79ff42cc9151340c26a22346)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:55.564310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:55.601271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3263d7b-b500-413c-a85a-df3871252b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:55.601945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3263d7b-b500-413c-a85a-df3871252b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:55.602281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3263d7b-b500-413c-a85a-df3871252b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:55.602497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3263d7b-b500-413c-a85a-df3871252b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:55.603176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3263d7b-b500-413c-a85a-df3871252b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:55.610211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3263d7b-b500-413c-a85a-df3871252b72 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:55.663945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 842/1679] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:55 2022] POST /identity/v3/projects => generated 365 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:55.667417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77763da6-815a-4f8b-a5c7-7c65f9f65548 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:55.667417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77763da6-815a-4f8b-a5c7-7c65f9f65548 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:55.667417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77763da6-815a-4f8b-a5c7-7c65f9f65548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:55.671387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1deeaaaa79ff42cc9151340c26a22346', 'request_id': 'req-31c56500-35a9-42d3-b097-74ec123174ed'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.673718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:55.695221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1deeaaaa79ff42cc9151340c26a22346', 'request_id': 'req-31c56500-35a9-42d3-b097-74ec123174ed'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.714877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1deeaaaa79ff42cc9151340c26a22346', 'request_id': 'req-31c56500-35a9-42d3-b097-74ec123174ed'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.735010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] The token cache is being invalidate because project 1deeaaaa79ff42cc9151340c26a22346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:35:55.735644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.737861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:55.740900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 838/1680] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:35:55 2022] DELETE /identity/v3/projects/1deeaaaa79ff42cc9151340c26a22346 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:55.741939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:55.749051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:55.780266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-77763da6-815a-4f8b-a5c7-7c65f9f65548 None None] MFA Rules not processed for user `d110c27fc9c045ea9a4eb49b4dafe221`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:55.781689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-77763da6-815a-4f8b-a5c7-7c65f9f65548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:55.891117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56500-35a9-42d3-b097-74ec123174ed admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:55.920176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 843/1681] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:35:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:55.928274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77763da6-815a-4f8b-a5c7-7c65f9f65548 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:55.932729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-77763da6-815a-4f8b-a5c7-7c65f9f65548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:55.961618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:55.962525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:55.963264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:55.963693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:55.966497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:56.026910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:56.086456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:56.089408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:56.101777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77763da6-815a-4f8b-a5c7-7c65f9f65548 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:56.117789 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec6515-a443-4514-adbb-bc18a07f8919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:56.118269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec6515-a443-4514-adbb-bc18a07f8919 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:56.118379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 839/1682] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:56.118577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec6515-a443-4514-adbb-bc18a07f8919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:56.118819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec6515-a443-4514-adbb-bc18a07f8919 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:56.119518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec6515-a443-4514-adbb-bc18a07f8919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:56.119659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:56.126334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec6515-a443-4514-adbb-bc18a07f8919 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:56.129718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:56.144958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af5966-e63d-45eb-a2fd-7f31db5e84b6 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:56.161452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:56.162576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:56.162576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:56.162767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] PATH_INFO: `/v3/users/7527c5bfcde644d08e13a11c07cac70d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:56.165004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7527c5bfcde644d08e13a11c07cac70d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:56.167015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:56.194272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 844/1683] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:55 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:56.196320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec6515-a443-4514-adbb-bc18a07f8919 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:56.201776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9fec6515-a443-4514-adbb-bc18a07f8919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:56.248329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec6515-a443-4514-adbb-bc18a07f8919 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:56.257218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd85733-3cfe-4080-97c5-c443ed935d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:56.259598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd85733-3cfe-4080-97c5-c443ed935d56 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:56.260602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd85733-3cfe-4080-97c5-c443ed935d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:56.260944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd85733-3cfe-4080-97c5-c443ed935d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:56.287159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd85733-3cfe-4080-97c5-c443ed935d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:56.296041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd85733-3cfe-4080-97c5-c443ed935d56 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:56.298149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=1,keystone:DELETE=8,keystone:SELECT=91 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:56.320654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 845/1684] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:56.325813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7527c5bfcde644d08e13a11c07cac70d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.326290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd85733-3cfe-4080-97c5-c443ed935d56 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:56.347271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7527c5bfcde644d08e13a11c07cac70d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.357713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7527c5bfcde644d08e13a11c07cac70d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.358813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7527c5bfcde644d08e13a11c07cac70d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.360850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd85733-3cfe-4080-97c5-c443ed935d56 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:56.361850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7527c5bfcde644d08e13a11c07cac70d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.372013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d16081-9626-4e16-a4f7-21dc0c4a9364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:56.374650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d16081-9626-4e16-a4f7-21dc0c4a9364 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:56.377137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d16081-9626-4e16-a4f7-21dc0c4a9364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:56.379320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d16081-9626-4e16-a4f7-21dc0c4a9364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:56.380091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d16081-9626-4e16-a4f7-21dc0c4a9364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:56.383528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d16081-9626-4e16-a4f7-21dc0c4a9364 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:56.409053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 840/1685] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:35:56 2022] DELETE /identity/v3/users/7527c5bfcde644d08e13a11c07cac70d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:56.409053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:56.411099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:56.423662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 846/1686] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:56.426435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d16081-9626-4e16-a4f7-21dc0c4a9364 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:56.429861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e3d16081-9626-4e16-a4f7-21dc0c4a9364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:56.450099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d16081-9626-4e16-a4f7-21dc0c4a9364 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:56.592513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb1641-ffd3-44cb-9747-164adfef5859 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:56.603478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:56.604161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:56.604444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:56.605140 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] PATH_INFO: `/v3/projects/b2074feb7f1c403ea7901aeff9659a6c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:56.607148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2074feb7f1c403ea7901aeff9659a6c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:56.613618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:56.619655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2b659-a5a0-4057-b90c-b9361425b5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:56.620225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2b659-a5a0-4057-b90c-b9361425b5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:56.620611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2b659-a5a0-4057-b90c-b9361425b5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:56.620817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2b659-a5a0-4057-b90c-b9361425b5c8 admin admin] PATH_INFO: `/v3/projects/87c6dbd8004643b7b8d0fa18a06a213f/users/d23b258c9d024fd499ebda3d22d26895/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:56.663567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2b659-a5a0-4057-b90c-b9361425b5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c6dbd8004643b7b8d0fa18a06a213f, user_id=d23b258c9d024fd499ebda3d22d26895, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:56.666275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2b659-a5a0-4057-b90c-b9361425b5c8 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:56.718077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 847/1687] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:56 2022] PUT /identity/v3/projects/87c6dbd8004643b7b8d0fa18a06a213f/users/d23b258c9d024fd499ebda3d22d26895/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:56.718738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2b659-a5a0-4057-b90c-b9361425b5c8 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:56.751767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2074feb7f1c403ea7901aeff9659a6c', 'request_id': 'req-533963ed-aae9-4d0b-9709-a7bdaf0ee624'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.763704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2074feb7f1c403ea7901aeff9659a6c', 'request_id': 'req-533963ed-aae9-4d0b-9709-a7bdaf0ee624'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.771829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2074feb7f1c403ea7901aeff9659a6c', 'request_id': 'req-533963ed-aae9-4d0b-9709-a7bdaf0ee624'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.790702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] The token cache is being invalidate because project b2074feb7f1c403ea7901aeff9659a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:35:56.791313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.791987 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-533963ed-aae9-4d0b-9709-a7bdaf0ee624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:56.794721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 841/1688] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:35:56 2022] DELETE /identity/v3/projects/b2074feb7f1c403ea7901aeff9659a6c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:56.800797 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40713c69-55ef-4ef4-b0f1-0b63aefea99e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:56.801451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40713c69-55ef-4ef4-b0f1-0b63aefea99e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:56.801798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40713c69-55ef-4ef4-b0f1-0b63aefea99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:56.843171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-40713c69-55ef-4ef4-b0f1-0b63aefea99e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:56.845129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-40713c69-55ef-4ef4-b0f1-0b63aefea99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:56.877891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2b659-a5a0-4057-b90c-b9361425b5c8 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:56.918109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:56.920532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:56.973099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 842/1689] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:56.980517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bb88c-46d4-4453-ab21-dbd41d8ca278 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:56.980805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bb88c-46d4-4453-ab21-dbd41d8ca278 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:56.981096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bb88c-46d4-4453-ab21-dbd41d8ca278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:56.985239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8db02e-1c3c-489d-85ca-2a0f3d358063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:56.986080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db02e-1c3c-489d-85ca-2a0f3d358063 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:56.986516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db02e-1c3c-489d-85ca-2a0f3d358063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:56.986929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db02e-1c3c-489d-85ca-2a0f3d358063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:56.987763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8db02e-1c3c-489d-85ca-2a0f3d358063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:56.989546 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8db02e-1c3c-489d-85ca-2a0f3d358063 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:57.004275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-138bb88c-46d4-4453-ab21-dbd41d8ca278 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:57.006042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-138bb88c-46d4-4453-ab21-dbd41d8ca278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:57.022305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 848/1690] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:57.023629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8db02e-1c3c-489d-85ca-2a0f3d358063 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:57.028597 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0e8db02e-1c3c-489d-85ca-2a0f3d358063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:57.040211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 843/1691] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:57.041830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bb88c-46d4-4453-ab21-dbd41d8ca278 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:57.063300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8db02e-1c3c-489d-85ca-2a0f3d358063 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:57.064476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bb88c-46d4-4453-ab21-dbd41d8ca278 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:57.073045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb814-4178-4579-8a3a-0fe0feb9610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:57.075255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74f612-4397-42de-9025-f27a4aefaf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:57.075721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb814-4178-4579-8a3a-0fe0feb9610e admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.075998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb814-4178-4579-8a3a-0fe0feb9610e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.076271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb814-4178-4579-8a3a-0fe0feb9610e admin admin] PATH_INFO: `/v3/projects/87c6dbd8004643b7b8d0fa18a06a213f/users/d23b258c9d024fd499ebda3d22d26895/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:57.077186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74f612-4397-42de-9025-f27a4aefaf0f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.077484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74f612-4397-42de-9025-f27a4aefaf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.078431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74f612-4397-42de-9025-f27a4aefaf0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:57.079682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74f612-4397-42de-9025-f27a4aefaf0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:57.079986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74f612-4397-42de-9025-f27a4aefaf0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:57.081507 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb814-4178-4579-8a3a-0fe0feb9610e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c6dbd8004643b7b8d0fa18a06a213f, user_id=d23b258c9d024fd499ebda3d22d26895, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:57.085355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74f612-4397-42de-9025-f27a4aefaf0f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:57.087805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb814-4178-4579-8a3a-0fe0feb9610e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:57.108826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 844/1692] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:57.114440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74f612-4397-42de-9025-f27a4aefaf0f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:57.117311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 849/1693] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:57 2022] PUT /identity/v3/projects/87c6dbd8004643b7b8d0fa18a06a213f/users/d23b258c9d024fd499ebda3d22d26895/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:57.130367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc3c7c-6271-4338-bc59-38dd5af36635 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.130651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc3c7c-6271-4338-bc59-38dd5af36635 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.130925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc3c7c-6271-4338-bc59-38dd5af36635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:57.149941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74f612-4397-42de-9025-f27a4aefaf0f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:57.179425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-90fc3c7c-6271-4338-bc59-38dd5af36635 None None] MFA Rules not processed for user `d23b258c9d024fd499ebda3d22d26895`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:57.181497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-90fc3c7c-6271-4338-bc59-38dd5af36635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:57.407877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef174b0e-53b9-4d22-9c1b-a71ea1a3428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:57.408810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174b0e-53b9-4d22-9c1b-a71ea1a3428d admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.411039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174b0e-53b9-4d22-9c1b-a71ea1a3428d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.411552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174b0e-53b9-4d22-9c1b-a71ea1a3428d admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:57.412931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef174b0e-53b9-4d22-9c1b-a71ea1a3428d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:57.425124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef174b0e-53b9-4d22-9c1b-a71ea1a3428d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:57.464782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 850/1694] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:57.487952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc3c7c-6271-4338-bc59-38dd5af36635 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:57.489603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-90fc3c7c-6271-4338-bc59-38dd5af36635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:57.519047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 845/1695] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:57 2022] POST /identity/v3/projects => generated 373 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:57.519959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef174b0e-53b9-4d22-9c1b-a71ea1a3428d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:57.621535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc3c7c-6271-4338-bc59-38dd5af36635 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:57.700293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef174b0e-53b9-4d22-9c1b-a71ea1a3428d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:57.706570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad845a5f-ca02-4407-8818-d84355eedc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:57.707359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845a5f-ca02-4407-8818-d84355eedc05 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.708221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845a5f-ca02-4407-8818-d84355eedc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.708620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845a5f-ca02-4407-8818-d84355eedc05 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:57.709773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845a5f-ca02-4407-8818-d84355eedc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:57.716391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845a5f-ca02-4407-8818-d84355eedc05 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:57.739848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dcf1b-9933-48e7-b1d6-0029bf733cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:57.740456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dcf1b-9933-48e7-b1d6-0029bf733cba service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.740748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dcf1b-9933-48e7-b1d6-0029bf733cba service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.741025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dcf1b-9933-48e7-b1d6-0029bf733cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:57.752701 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:57.806778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 846/1696] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:57 2022] POST /identity/v3/users => generated 287 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:57.812106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101d3b8-aeb0-4c11-821f-0d1a91861093 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.813548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101d3b8-aeb0-4c11-821f-0d1a91861093 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.815729 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101d3b8-aeb0-4c11-821f-0d1a91861093 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:57.823011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 847/1697] 10.222.0.69 () {54 vars in 961 bytes} [Thu Aug 4 02:35:57 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:35:57.826024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101d3b8-aeb0-4c11-821f-0d1a91861093 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:57.857951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dcf1b-9933-48e7-b1d6-0029bf733cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:57.864108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dcf1b-9933-48e7-b1d6-0029bf733cba service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:57.869697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101d3b8-aeb0-4c11-821f-0d1a91861093 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:57.882393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbd7c1-c5b4-4068-afc4-41372e51a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:57.883290 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbd7c1-c5b4-4068-afc4-41372e51a130 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.883578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbd7c1-c5b4-4068-afc4-41372e51a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.883902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbd7c1-c5b4-4068-afc4-41372e51a130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:57.884619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbd7c1-c5b4-4068-afc4-41372e51a130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:57.886681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 851/1698] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:35:57.889135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1fbcb-785e-4411-b64c-a6e848d4e9b3 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.889676 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1fbcb-785e-4411-b64c-a6e848d4e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.890184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1fbcb-785e-4411-b64c-a6e848d4e9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:57.899712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbd7c1-c5b4-4068-afc4-41372e51a130 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:57.950146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 848/1699] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:57.953037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbd7c1-c5b4-4068-afc4-41372e51a130 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:57.956992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f6dbd7c1-c5b4-4068-afc4-41372e51a130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:57.983681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-74e1fbcb-785e-4411-b64c-a6e848d4e9b3 None None] MFA Rules not processed for user `234cbff2a729458a8dad108baaba6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:57.985554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbd7c1-c5b4-4068-afc4-41372e51a130 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:57.987126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-74e1fbcb-785e-4411-b64c-a6e848d4e9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:57.997964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:57.998779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:57.999063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:57.999336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] PATH_INFO: `/v3/projects/d2250ed9ddaf446ca3417db52b802da8` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:58.001031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2250ed9ddaf446ca3417db52b802da8)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:58.006136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:58.080104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:58.117964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2250ed9ddaf446ca3417db52b802da8', 'request_id': 'req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:58.135284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2250ed9ddaf446ca3417db52b802da8', 'request_id': 'req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:58.142412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2250ed9ddaf446ca3417db52b802da8', 'request_id': 'req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:58.162307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 852/1700] 10.222.0.69 () {58 vars in 1058 bytes} [Thu Aug 4 02:35:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:58.163878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1fbcb-785e-4411-b64c-a6e848d4e9b3 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:58.184725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] The token cache is being invalidate because project d2250ed9ddaf446ca3417db52b802da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:35:58.184725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:58.185457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:58.188747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 849/1701] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:35:57 2022] DELETE /identity/v3/projects/d2250ed9ddaf446ca3417db52b802da8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:58.188747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:58.189654 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:58.191380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1fbcb-785e-4411-b64c-a6e848d4e9b3 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:58.305794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d019bf-c9b1-41d5-b85f-3f9b6f115fc1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:58.314497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3d048-71eb-4c25-a811-d7217c090241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:58.315233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3d048-71eb-4c25-a811-d7217c090241 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:58.317320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3d048-71eb-4c25-a811-d7217c090241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:58.317320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3d048-71eb-4c25-a811-d7217c090241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:58.325025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a8a3d048-71eb-4c25-a811-d7217c090241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:58.378816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac565-1f92-4e22-a404-981a80ef4b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:58.379745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac565-1f92-4e22-a404-981a80ef4b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:58.380172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac565-1f92-4e22-a404-981a80ef4b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:58.380587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dac565-1f92-4e22-a404-981a80ef4b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:58.381456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dac565-1f92-4e22-a404-981a80ef4b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:58.383496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dac565-1f92-4e22-a404-981a80ef4b65 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:58.411859 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 853/1702] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:35:58.413170 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac565-1f92-4e22-a404-981a80ef4b65 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:58.425766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-71dac565-1f92-4e22-a404-981a80ef4b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:58.482227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3d048-71eb-4c25-a811-d7217c090241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:58.483700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3d048-71eb-4c25-a811-d7217c090241 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:58.505657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 850/1703] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:58.507117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041851-a5bd-4b0a-a5c1-2197bbf1c161 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:58.507411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041851-a5bd-4b0a-a5c1-2197bbf1c161 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:58.507740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041851-a5bd-4b0a-a5c1-2197bbf1c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:58.508784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:58.559561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5e041851-a5bd-4b0a-a5c1-2197bbf1c161 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:58.560842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5e041851-a5bd-4b0a-a5c1-2197bbf1c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:58.596505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 851/1704] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:58.596505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e041851-a5bd-4b0a-a5c1-2197bbf1c161 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:58.596505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5e041851-a5bd-4b0a-a5c1-2197bbf1c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:58.604572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dac565-1f92-4e22-a404-981a80ef4b65 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:58.612980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:58.614090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:58.614671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:58.615147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:58.617258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:58.626894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e041851-a5bd-4b0a-a5c1-2197bbf1c161 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:58.638959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91a1f-4e89-4c4b-97c8-b2530b281d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:58.640721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91a1f-4e89-4c4b-97c8-b2530b281d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:58.640721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91a1f-4e89-4c4b-97c8-b2530b281d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:58.640721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91a1f-4e89-4c4b-97c8-b2530b281d4d admin admin] PATH_INFO: `/v3/projects/5c8833e93aa84c07aee8b90b14a2c2d2/users/075d4bca70fc4743869f177018065219/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:58.647380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:58.649234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:58.664763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 854/1705] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:35:58.666597 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:58.672283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:58.684094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91a1f-4e89-4c4b-97c8-b2530b281d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8833e93aa84c07aee8b90b14a2c2d2, user_id=075d4bca70fc4743869f177018065219, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:58.690386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91a1f-4e89-4c4b-97c8-b2530b281d4d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:58.693471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aaccc-73c4-4c32-aaeb-7164b5cfcafa service placement] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:58.701275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:58.702101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:58.702483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:58.703601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] PATH_INFO: `/v3/projects/5a1acca3f6294416849f02a641360cef` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:58.705295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1acca3f6294416849f02a641360cef)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:58.707576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:58.733724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 852/1706] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:35:58 2022] PUT /identity/v3/projects/5c8833e93aa84c07aee8b90b14a2c2d2/users/075d4bca70fc4743869f177018065219/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:58.735308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74a92a-7047-4375-a9f8-9bf1f27dcdfd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:58.735737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74a92a-7047-4375-a9f8-9bf1f27dcdfd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:58.736174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74a92a-7047-4375-a9f8-9bf1f27dcdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:58.803567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4c74a92a-7047-4375-a9f8-9bf1f27dcdfd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:58.805832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4c74a92a-7047-4375-a9f8-9bf1f27dcdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:58.880211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1acca3f6294416849f02a641360cef', 'request_id': 'req-e41f9878-6ab4-4c38-85c6-891a72d0bd36'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:58.916409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1acca3f6294416849f02a641360cef', 'request_id': 'req-e41f9878-6ab4-4c38-85c6-891a72d0bd36'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:58.949731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1acca3f6294416849f02a641360cef', 'request_id': 'req-e41f9878-6ab4-4c38-85c6-891a72d0bd36'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:59.012542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:59.019118 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] The token cache is being invalidate because project 5a1acca3f6294416849f02a641360cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:35:59.019398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:59.021719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e41f9878-6ab4-4c38-85c6-891a72d0bd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:35:59.034514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 855/1707] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:35:58 2022] DELETE /identity/v3/projects/5a1acca3f6294416849f02a641360cef => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:35:59.035893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f14d26-0fb1-45ae-88d0-123ba23835d0 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:59.036183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f14d26-0fb1-45ae-88d0-123ba23835d0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:59.036462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f14d26-0fb1-45ae-88d0-123ba23835d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:59.128475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 853/1708] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:59.129095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e27249-f4c5-4b00-8197-acaeaab0235f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:59.130248 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e27249-f4c5-4b00-8197-acaeaab0235f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:59.130427 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e27249-f4c5-4b00-8197-acaeaab0235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:59.148485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-19f14d26-0fb1-45ae-88d0-123ba23835d0 None None] MFA Rules not processed for user `075d4bca70fc4743869f177018065219`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:59.148714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-19f14d26-0fb1-45ae-88d0-123ba23835d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:59.174108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-96e27249-f4c5-4b00-8197-acaeaab0235f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:59.175324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-96e27249-f4c5-4b00-8197-acaeaab0235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:59.205275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 854/1709] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:59.227664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e27249-f4c5-4b00-8197-acaeaab0235f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:59.243612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e27249-f4c5-4b00-8197-acaeaab0235f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:59.252033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81248020-7d79-4d1e-9e52-7837bf6d2eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:59.252902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248020-7d79-4d1e-9e52-7837bf6d2eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:59.253416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248020-7d79-4d1e-9e52-7837bf6d2eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:59.253881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248020-7d79-4d1e-9e52-7837bf6d2eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:59.254802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81248020-7d79-4d1e-9e52-7837bf6d2eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:59.255296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81248020-7d79-4d1e-9e52-7837bf6d2eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:59.257225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81248020-7d79-4d1e-9e52-7837bf6d2eb2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:59.279484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 855/1710] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:59.281696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b0da-c2fa-4e22-a900-706760ead1ae None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:59.282488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b0da-c2fa-4e22-a900-706760ead1ae None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:59.282964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b0da-c2fa-4e22-a900-706760ead1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:59.327493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-07f8b0da-c2fa-4e22-a900-706760ead1ae None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:59.330243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-07f8b0da-c2fa-4e22-a900-706760ead1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:59.355754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 856/1711] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:59.357483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676d423-4658-4cd0-96a8-6b1f2ad48169 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:59.357772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676d423-4658-4cd0-96a8-6b1f2ad48169 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:59.362293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676d423-4658-4cd0-96a8-6b1f2ad48169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:59.394395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 856/1712] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:59.395335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f14d26-0fb1-45ae-88d0-123ba23835d0 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:59.432133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f14d26-0fb1-45ae-88d0-123ba23835d0 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:59.437761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d429b-43ba-479b-b0a0-ec606b9477a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:59.438201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d429b-43ba-479b-b0a0-ec606b9477a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:59.438482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d429b-43ba-479b-b0a0-ec606b9477a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:59.438794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d429b-43ba-479b-b0a0-ec606b9477a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:59.439769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d429b-43ba-479b-b0a0-ec606b9477a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:59.442173 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d429b-43ba-479b-b0a0-ec606b9477a3 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:59.485527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4676d423-4658-4cd0-96a8-6b1f2ad48169 None None] MFA Rules not processed for user `a1631559d5194f1fa449a16f93546349`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:35:59.493830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4676d423-4658-4cd0-96a8-6b1f2ad48169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:59.513985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 857/1713] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:59 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:59.513985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d429b-43ba-479b-b0a0-ec606b9477a3 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:59.572133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:35:59.722251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d429b-43ba-479b-b0a0-ec606b9477a3 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:59.742247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e3716-f1f0-48ab-9de8-a460f99fff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:59.746749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e3716-f1f0-48ab-9de8-a460f99fff36 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:59.747041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e3716-f1f0-48ab-9de8-a460f99fff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:59.747315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e3716-f1f0-48ab-9de8-a460f99fff36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:59.748057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e3716-f1f0-48ab-9de8-a460f99fff36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:35:59.751442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e3716-f1f0-48ab-9de8-a460f99fff36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:59.755372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e3716-f1f0-48ab-9de8-a460f99fff36 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:59.772779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 857/1714] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:35:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:35:59.773806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676d423-4658-4cd0-96a8-6b1f2ad48169 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:59.774053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 858/1715] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:35:59.775195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4676d423-4658-4cd0-96a8-6b1f2ad48169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:59.775373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e3716-f1f0-48ab-9de8-a460f99fff36 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:59.796226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e3716-f1f0-48ab-9de8-a460f99fff36 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:59.800661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676d423-4658-4cd0-96a8-6b1f2ad48169 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:35:59.810532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6939-45c7-42da-9027-15e2f03cf39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:59.811185 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6939-45c7-42da-9027-15e2f03cf39a admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:59.813188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24c31-e697-4cdc-9f67-5b5a145ecc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:35:59.813847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24c31-e697-4cdc-9f67-5b5a145ecc93 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:35:59.814129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24c31-e697-4cdc-9f67-5b5a145ecc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:59.814404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24c31-e697-4cdc-9f67-5b5a145ecc93 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:59.815366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6939-45c7-42da-9027-15e2f03cf39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:35:59.815686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f6939-45c7-42da-9027-15e2f03cf39a admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:35:59.816558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f6939-45c7-42da-9027-15e2f03cf39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:59.817704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca24c31-e697-4cdc-9f67-5b5a145ecc93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:35:59.820463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f6939-45c7-42da-9027-15e2f03cf39a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:59.822743 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca24c31-e697-4cdc-9f67-5b5a145ecc93 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:35:59.897438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 859/1716] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:35:59 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:59.901135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24c31-e697-4cdc-9f67-5b5a145ecc93 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:59.914384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 858/1717] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:59 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:35:59.920087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6939-45c7-42da-9027-15e2f03cf39a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:35:59.922743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ed8f6939-45c7-42da-9027-15e2f03cf39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:35:59.940864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24c31-e697-4cdc-9f67-5b5a145ecc93 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.185917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b919-b91f-43a8-9fc5-eecdbbc80fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.186501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b919-b91f-43a8-9fc5-eecdbbc80fab admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.187905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b919-b91f-43a8-9fc5-eecdbbc80fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.188240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b919-b91f-43a8-9fc5-eecdbbc80fab admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.196638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12b919-b91f-43a8-9fc5-eecdbbc80fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.199433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12b919-b91f-43a8-9fc5-eecdbbc80fab admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.220579 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f6939-45c7-42da-9027-15e2f03cf39a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.237180 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a0b7a-b127-4ef2-b31e-ff2a30fef081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.241776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0b7a-b127-4ef2-b31e-ff2a30fef081 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.242139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0b7a-b127-4ef2-b31e-ff2a30fef081 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.242587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0b7a-b127-4ef2-b31e-ff2a30fef081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.288162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:00.289615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 860/1718] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:35:59 2022] POST /identity/v3/projects => generated 363 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:00.296233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b919-b91f-43a8-9fc5-eecdbbc80fab admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:00.425019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a0b7a-b127-4ef2-b31e-ff2a30fef081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.427513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a0b7a-b127-4ef2-b31e-ff2a30fef081 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.439988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 859/1719] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:35:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:00.441057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a0b7a-b127-4ef2-b31e-ff2a30fef081 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:00.455128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a0b7a-b127-4ef2-b31e-ff2a30fef081 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.528740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b919-b91f-43a8-9fc5-eecdbbc80fab admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.540604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ff965-bd80-480f-b614-79e97c4b8347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.541794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ff965-bd80-480f-b614-79e97c4b8347 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.541794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ff965-bd80-480f-b614-79e97c4b8347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.541965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ff965-bd80-480f-b614-79e97c4b8347 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.543356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ff965-bd80-480f-b614-79e97c4b8347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.545454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef1880-285d-41c6-b495-ac16500449f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.545657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ff965-bd80-480f-b614-79e97c4b8347 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.549033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1880-285d-41c6-b495-ac16500449f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.551770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1880-285d-41c6-b495-ac16500449f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.552429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1880-285d-41c6-b495-ac16500449f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.553468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef1880-285d-41c6-b495-ac16500449f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.555750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef1880-285d-41c6-b495-ac16500449f5 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.573156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 861/1720] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:00.574638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef1880-285d-41c6-b495-ac16500449f5 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:00.585924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef1880-285d-41c6-b495-ac16500449f5 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.598598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a71e52-a432-4e20-83a9-47d26348477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.598871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a71e52-a432-4e20-83a9-47d26348477b admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.599399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a71e52-a432-4e20-83a9-47d26348477b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.599755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a71e52-a432-4e20-83a9-47d26348477b admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.600571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a71e52-a432-4e20-83a9-47d26348477b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.603086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 860/1721] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:00 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:00.605604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ff965-bd80-480f-b614-79e97c4b8347 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:00.606579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a71e52-a432-4e20-83a9-47d26348477b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.635990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ff965-bd80-480f-b614-79e97c4b8347 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.637289 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:00.650805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576513bf-7dcd-4b09-8044-60e6f6b21787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.654241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576513bf-7dcd-4b09-8044-60e6f6b21787 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.654387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576513bf-7dcd-4b09-8044-60e6f6b21787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.654679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576513bf-7dcd-4b09-8044-60e6f6b21787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.656989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576513bf-7dcd-4b09-8044-60e6f6b21787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.662838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576513bf-7dcd-4b09-8044-60e6f6b21787 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.676676 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 862/1722] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:00 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:00.677471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a71e52-a432-4e20-83a9-47d26348477b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:00.692760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a71e52-a432-4e20-83a9-47d26348477b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.711627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 861/1723] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:00.713722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576513bf-7dcd-4b09-8044-60e6f6b21787 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:00.726570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa00c1e-e7a9-43b4-9894-ce041e1f933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.735659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa00c1e-e7a9-43b4-9894-ce041e1f933b admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.736099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa00c1e-e7a9-43b4-9894-ce041e1f933b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.736476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa00c1e-e7a9-43b4-9894-ce041e1f933b admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.738679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa00c1e-e7a9-43b4-9894-ce041e1f933b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.739815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576513bf-7dcd-4b09-8044-60e6f6b21787 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.742525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa00c1e-e7a9-43b4-9894-ce041e1f933b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.756263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45443e7e-77eb-4671-9083-0007763a900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.756900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443e7e-77eb-4671-9083-0007763a900c admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.757178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443e7e-77eb-4671-9083-0007763a900c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.758046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45443e7e-77eb-4671-9083-0007763a900c admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.761170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45443e7e-77eb-4671-9083-0007763a900c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.767884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 863/1724] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:00.769053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45443e7e-77eb-4671-9083-0007763a900c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.769183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa00c1e-e7a9-43b4-9894-ce041e1f933b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:00.791735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa00c1e-e7a9-43b4-9894-ce041e1f933b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.799009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b97df-2dc1-4ed7-948f-dee703de6027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.799952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b97df-2dc1-4ed7-948f-dee703de6027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.800282 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b97df-2dc1-4ed7-948f-dee703de6027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.801025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b97df-2dc1-4ed7-948f-dee703de6027 admin admin] PATH_INFO: `/v3/projects/5b6902135b474f42803faa3f32c2966e/users/af09bdf1242d43f1804ababa1af44376/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.806819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 862/1725] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:00.808932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45443e7e-77eb-4671-9083-0007763a900c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:00.829311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b97df-2dc1-4ed7-948f-dee703de6027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6902135b474f42803faa3f32c2966e, user_id=af09bdf1242d43f1804ababa1af44376, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.832906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b97df-2dc1-4ed7-948f-dee703de6027 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.841621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45443e7e-77eb-4671-9083-0007763a900c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:00.856103 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 864/1726] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:00 2022] PUT /identity/v3/projects/5b6902135b474f42803faa3f32c2966e/users/af09bdf1242d43f1804ababa1af44376/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:00.857266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b97df-2dc1-4ed7-948f-dee703de6027 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:00.871844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf6b78-70d0-4d4f-af9f-d74932dc8c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:00.872548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf6b78-70d0-4d4f-af9f-d74932dc8c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.872843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf6b78-70d0-4d4f-af9f-d74932dc8c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.873113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf6b78-70d0-4d4f-af9f-d74932dc8c42 admin admin] PATH_INFO: `/v3/projects/f331560caf78488398519f8580166e24/users/c671a130533045f89a103fbb3368b768/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:00.920510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf6b78-70d0-4d4f-af9f-d74932dc8c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f331560caf78488398519f8580166e24, user_id=c671a130533045f89a103fbb3368b768, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:00.923700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf6b78-70d0-4d4f-af9f-d74932dc8c42 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:00.990171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 863/1727] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:00 2022] PUT /identity/v3/projects/f331560caf78488398519f8580166e24/users/c671a130533045f89a103fbb3368b768/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:00.991563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac439f3-bc8c-4379-8a0b-407500597102 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:00.991857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac439f3-bc8c-4379-8a0b-407500597102 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:00.992133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac439f3-bc8c-4379-8a0b-407500597102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.029729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b97df-2dc1-4ed7-948f-dee703de6027 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:01.134912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4ac439f3-bc8c-4379-8a0b-407500597102 None None] MFA Rules not processed for user `af09bdf1242d43f1804ababa1af44376`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:01.136764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4ac439f3-bc8c-4379-8a0b-407500597102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:01.198273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07070f6-505b-4da1-870b-316270ca794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:01.204175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07070f6-505b-4da1-870b-316270ca794e admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:01.206061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07070f6-505b-4da1-870b-316270ca794e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:01.206511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07070f6-505b-4da1-870b-316270ca794e admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.208933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07070f6-505b-4da1-870b-316270ca794e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:01.215361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07070f6-505b-4da1-870b-316270ca794e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:01.236171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 865/1728] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:01.237189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07070f6-505b-4da1-870b-316270ca794e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:01.264674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07070f6-505b-4da1-870b-316270ca794e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:01.276545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4af8cd-1d7a-4860-8302-3e7eae351e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:01.278874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4af8cd-1d7a-4860-8302-3e7eae351e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:01.280296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4af8cd-1d7a-4860-8302-3e7eae351e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:01.281025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4af8cd-1d7a-4860-8302-3e7eae351e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.282719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4af8cd-1d7a-4860-8302-3e7eae351e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:01.285143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4af8cd-1d7a-4860-8302-3e7eae351e46 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:01.312311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:01.312832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 866/1729] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:01.313765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4af8cd-1d7a-4860-8302-3e7eae351e46 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:01.336600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4af8cd-1d7a-4860-8302-3e7eae351e46 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:01.346467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01b65d-e828-461c-9b9a-b360cab759f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:01.347242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01b65d-e828-461c-9b9a-b360cab759f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:01.347528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01b65d-e828-461c-9b9a-b360cab759f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:01.347809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01b65d-e828-461c-9b9a-b360cab759f2 admin admin] PATH_INFO: `/v3/projects/15a8738d93864d8481b83760857829ad/users/fd7acc25d51f40e69a7772b304b15cb8/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.360620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 864/1730] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:01.363180 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac439f3-bc8c-4379-8a0b-407500597102 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:01.380838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01b65d-e828-461c-9b9a-b360cab759f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a8738d93864d8481b83760857829ad, user_id=fd7acc25d51f40e69a7772b304b15cb8, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:01.388295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01b65d-e828-461c-9b9a-b360cab759f2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:01.397070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac439f3-bc8c-4379-8a0b-407500597102 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:01.407280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331669c0-f26a-4e56-ae2b-9de378984cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:01.408032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331669c0-f26a-4e56-ae2b-9de378984cef admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:01.408278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331669c0-f26a-4e56-ae2b-9de378984cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:01.408562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331669c0-f26a-4e56-ae2b-9de378984cef admin admin] PATH_INFO: `/v3/projects/f331560caf78488398519f8580166e24/users/c671a130533045f89a103fbb3368b768/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.413819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331669c0-f26a-4e56-ae2b-9de378984cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f331560caf78488398519f8580166e24, user_id=c671a130533045f89a103fbb3368b768, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:01.416674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331669c0-f26a-4e56-ae2b-9de378984cef admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:01.428253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 867/1731] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:01 2022] PUT /identity/v3/projects/15a8738d93864d8481b83760857829ad/users/fd7acc25d51f40e69a7772b304b15cb8/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:01.430101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01b65d-e828-461c-9b9a-b360cab759f2 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:01.465471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 865/1732] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:01 2022] PUT /identity/v3/projects/f331560caf78488398519f8580166e24/users/c671a130533045f89a103fbb3368b768/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:01.465471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7ffef-1223-4b6f-95dd-625825c36bb8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:01.465471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7ffef-1223-4b6f-95dd-625825c36bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:01.465471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7ffef-1223-4b6f-95dd-625825c36bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.506270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:01.550872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-77a7ffef-1223-4b6f-95dd-625825c36bb8 None None] MFA Rules not processed for user `fd7acc25d51f40e69a7772b304b15cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:01.557380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-77a7ffef-1223-4b6f-95dd-625825c36bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:01.559163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01b65d-e828-461c-9b9a-b360cab759f2 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:01.634792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235bd4d-183f-482f-8041-1022ddd6d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:01.635581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235bd4d-183f-482f-8041-1022ddd6d739 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:01.635908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235bd4d-183f-482f-8041-1022ddd6d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:01.637273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235bd4d-183f-482f-8041-1022ddd6d739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.638273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235bd4d-183f-482f-8041-1022ddd6d739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:01.640294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235bd4d-183f-482f-8041-1022ddd6d739 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:01.687603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 868/1733] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:01 2022] POST /identity/v3/projects => generated 371 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:01.689174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d189b12-c0d1-475b-8904-1a74e0c09a64 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:01.690935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d189b12-c0d1-475b-8904-1a74e0c09a64 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:01.691296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d189b12-c0d1-475b-8904-1a74e0c09a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.712113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 866/1734] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:01.715630 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7ffef-1223-4b6f-95dd-625825c36bb8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:01.739299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7ffef-1223-4b6f-95dd-625825c36bb8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:01.760237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-1d189b12-c0d1-475b-8904-1a74e0c09a64 None None] MFA Rules not processed for user `c671a130533045f89a103fbb3368b768`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:01.766146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1d189b12-c0d1-475b-8904-1a74e0c09a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:01.886282 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48168a-6921-4241-9ae0-b24d96ed8f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:01.887293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48168a-6921-4241-9ae0-b24d96ed8f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:01.890654 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48168a-6921-4241-9ae0-b24d96ed8f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:01.891188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48168a-6921-4241-9ae0-b24d96ed8f79 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.892168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48168a-6921-4241-9ae0-b24d96ed8f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:01.896899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48168a-6921-4241-9ae0-b24d96ed8f79 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:01.909516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 869/1735] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:01.911242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d189b12-c0d1-475b-8904-1a74e0c09a64 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:01.933962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d189b12-c0d1-475b-8904-1a74e0c09a64 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:01.957721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 867/1736] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:01 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:01.957721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48168a-6921-4241-9ae0-b24d96ed8f79 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:01.958523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde1d59-8b6f-45d6-8802-dd75afe8366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:01.960868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4e48168a-6921-4241-9ae0-b24d96ed8f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:01.961356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde1d59-8b6f-45d6-8802-dd75afe8366e admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:01.961886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde1d59-8b6f-45d6-8802-dd75afe8366e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:01.963378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde1d59-8b6f-45d6-8802-dd75afe8366e admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:01.965267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde1d59-8b6f-45d6-8802-dd75afe8366e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:01.972782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde1d59-8b6f-45d6-8802-dd75afe8366e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:02.041280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 870/1737] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:01 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:02.043730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde1d59-8b6f-45d6-8802-dd75afe8366e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:02.121692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:02.149703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48168a-6921-4241-9ae0-b24d96ed8f79 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:02.162573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:02.209352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde1d59-8b6f-45d6-8802-dd75afe8366e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:02.223338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10566b-61f9-45df-81b3-86d959765474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:02.223658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a3ff7-0cdb-49ba-96bf-9383145556bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:02.224311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a3ff7-0cdb-49ba-96bf-9383145556bc admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:02.224592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a3ff7-0cdb-49ba-96bf-9383145556bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:02.224866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a3ff7-0cdb-49ba-96bf-9383145556bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:02.225002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10566b-61f9-45df-81b3-86d959765474 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:02.225453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10566b-61f9-45df-81b3-86d959765474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:02.225864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10566b-61f9-45df-81b3-86d959765474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:02.230449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a3ff7-0cdb-49ba-96bf-9383145556bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:02.232105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a3ff7-0cdb-49ba-96bf-9383145556bc admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:02.289681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 871/1738] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:02.299269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a3ff7-0cdb-49ba-96bf-9383145556bc admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:02.361364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a3ff7-0cdb-49ba-96bf-9383145556bc admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:02.395097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10566b-61f9-45df-81b3-86d959765474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:02.397384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10566b-61f9-45df-81b3-86d959765474 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:02.398242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad850273-d942-4980-97b2-e57105d1a3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:02.398877 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad850273-d942-4980-97b2-e57105d1a3ff admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:02.399182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad850273-d942-4980-97b2-e57105d1a3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:02.404551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad850273-d942-4980-97b2-e57105d1a3ff admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:02.404963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad850273-d942-4980-97b2-e57105d1a3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:02.412505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad850273-d942-4980-97b2-e57105d1a3ff admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:02.434704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 868/1739] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:02.435880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10566b-61f9-45df-81b3-86d959765474 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:02.469457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10566b-61f9-45df-81b3-86d959765474 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:02.483362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029dfa-b075-4a04-a11d-2f3a0ff4f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:02.484334 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029dfa-b075-4a04-a11d-2f3a0ff4f2dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:02.484762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029dfa-b075-4a04-a11d-2f3a0ff4f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:02.485588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31029dfa-b075-4a04-a11d-2f3a0ff4f2dd admin admin] PATH_INFO: `/v3/projects/20929e69a97647529b624165ea6c2733/users/66fa031db58641e6850f2f551af2d4b7/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:02.514941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 872/1740] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:02 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:02.516006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad850273-d942-4980-97b2-e57105d1a3ff admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:02.528042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31029dfa-b075-4a04-a11d-2f3a0ff4f2dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=20929e69a97647529b624165ea6c2733, user_id=66fa031db58641e6850f2f551af2d4b7, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:02.532941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31029dfa-b075-4a04-a11d-2f3a0ff4f2dd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:02.574385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad850273-d942-4980-97b2-e57105d1a3ff admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:02.576756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 869/1741] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:02 2022] PUT /identity/v3/projects/20929e69a97647529b624165ea6c2733/users/66fa031db58641e6850f2f551af2d4b7/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:02.581292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029dfa-b075-4a04-a11d-2f3a0ff4f2dd admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:02.748265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31029dfa-b075-4a04-a11d-2f3a0ff4f2dd admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:02.761658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1970259-1aa4-4933-b360-a4133b0c9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:02.762299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1970259-1aa4-4933-b360-a4133b0c9411 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:02.762577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1970259-1aa4-4933-b360-a4133b0c9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:02.762848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1970259-1aa4-4933-b360-a4133b0c9411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:02.763551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1970259-1aa4-4933-b360-a4133b0c9411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:02.773642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1970259-1aa4-4933-b360-a4133b0c9411 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:02.798815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 870/1742] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:02.799753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1970259-1aa4-4933-b360-a4133b0c9411 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:02.822028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c2f86-a648-46b9-8d8f-0457326fcabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:02.825564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c2f86-a648-46b9-8d8f-0457326fcabc admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:02.825564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c2f86-a648-46b9-8d8f-0457326fcabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:02.825802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c2f86-a648-46b9-8d8f-0457326fcabc admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:02.826525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c2f86-a648-46b9-8d8f-0457326fcabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:02.829527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1970259-1aa4-4933-b360-a4133b0c9411 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:02.834397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c2f86-a648-46b9-8d8f-0457326fcabc admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:02.842294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda22543-f690-4ba8-9fab-91b6a2c997f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:02.843310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22543-f690-4ba8-9fab-91b6a2c997f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:02.845300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22543-f690-4ba8-9fab-91b6a2c997f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:02.845801 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22543-f690-4ba8-9fab-91b6a2c997f1 admin admin] PATH_INFO: `/v3/projects/20929e69a97647529b624165ea6c2733/users/66fa031db58641e6850f2f551af2d4b7/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:02.850870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda22543-f690-4ba8-9fab-91b6a2c997f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20929e69a97647529b624165ea6c2733, user_id=66fa031db58641e6850f2f551af2d4b7, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:02.860362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda22543-f690-4ba8-9fab-91b6a2c997f1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:02.883970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 873/1743] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:02.884955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c2f86-a648-46b9-8d8f-0457326fcabc admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:02.897738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 871/1744] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:02 2022] PUT /identity/v3/projects/20929e69a97647529b624165ea6c2733/users/66fa031db58641e6850f2f551af2d4b7/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:02.902970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc40856-d7b9-41ca-b698-1f18bf08c500 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:02.903415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc40856-d7b9-41ca-b698-1f18bf08c500 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:02.903840 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc40856-d7b9-41ca-b698-1f18bf08c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:02.932347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c2f86-a648-46b9-8d8f-0457326fcabc admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:02.977699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7dc40856-d7b9-41ca-b698-1f18bf08c500 None None] MFA Rules not processed for user `66fa031db58641e6850f2f551af2d4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:02.980962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7dc40856-d7b9-41ca-b698-1f18bf08c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:03.007470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:03.141065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb819b2-b907-4438-899d-5a561c614f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:03.143353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb819b2-b907-4438-899d-5a561c614f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:03.143831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb819b2-b907-4438-899d-5a561c614f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:03.144406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb819b2-b907-4438-899d-5a561c614f57 admin admin] PATH_INFO: `/v3/projects/33d1e269d5064ed1826fe15fa7e92c0f/users/50571e27460341d58d554284b0f7f3e2/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:03.202949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb819b2-b907-4438-899d-5a561c614f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d1e269d5064ed1826fe15fa7e92c0f, user_id=50571e27460341d58d554284b0f7f3e2, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:03.209678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb819b2-b907-4438-899d-5a561c614f57 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:03.250138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 874/1745] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:02 2022] PUT /identity/v3/projects/33d1e269d5064ed1826fe15fa7e92c0f/users/50571e27460341d58d554284b0f7f3e2/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:03.250527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282ef7f-ad39-4d75-a328-b552a0bc91e4 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:03.250821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282ef7f-ad39-4d75-a328-b552a0bc91e4 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:03.253009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282ef7f-ad39-4d75-a328-b552a0bc91e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:03.257923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 872/1746] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:03.271881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc40856-d7b9-41ca-b698-1f18bf08c500 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:03.352071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc40856-d7b9-41ca-b698-1f18bf08c500 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:03.371620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:03.453928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4282ef7f-ad39-4d75-a328-b552a0bc91e4 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:03.464894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4282ef7f-ad39-4d75-a328-b552a0bc91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:03.633366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e19b0-44f0-4f78-bf9a-6fdc247c7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:03.637317 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e19b0-44f0-4f78-bf9a-6fdc247c7842 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:03.637636 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e19b0-44f0-4f78-bf9a-6fdc247c7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:03.637918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e19b0-44f0-4f78-bf9a-6fdc247c7842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:03.638653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e19b0-44f0-4f78-bf9a-6fdc247c7842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:03.642320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e19b0-44f0-4f78-bf9a-6fdc247c7842 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:03.656646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 875/1747] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:36:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:03.659837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20244d56-3352-4d8c-a07d-15eb1c46e243 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:03.662183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20244d56-3352-4d8c-a07d-15eb1c46e243 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:03.664800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20244d56-3352-4d8c-a07d-15eb1c46e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:03.685175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 873/1748] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:03.686121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e19b0-44f0-4f78-bf9a-6fdc247c7842 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:03.762193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-20244d56-3352-4d8c-a07d-15eb1c46e243 None None] MFA Rules not processed for user `7be58892888f468d9caaeec9f02c5fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:03.763863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-20244d56-3352-4d8c-a07d-15eb1c46e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:03.889231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e19b0-44f0-4f78-bf9a-6fdc247c7842 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:03.897589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50d292-439b-4bbb-bd67-57646810b455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:03.901237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d292-439b-4bbb-bd67-57646810b455 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:03.904084 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d292-439b-4bbb-bd67-57646810b455 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:03.904542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d292-439b-4bbb-bd67-57646810b455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:03.914410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 876/1749] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:03.916365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20244d56-3352-4d8c-a07d-15eb1c46e243 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:03.954754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20244d56-3352-4d8c-a07d-15eb1c46e243 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:03.960429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c15f-ed9e-40f4-b6bd-9cb7de34a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:03.961149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c15f-ed9e-40f4-b6bd-9cb7de34a931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:03.961465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c15f-ed9e-40f4-b6bd-9cb7de34a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:03.961748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c15f-ed9e-40f4-b6bd-9cb7de34a931 admin admin] PATH_INFO: `/v3/projects/33d1e269d5064ed1826fe15fa7e92c0f/users/50571e27460341d58d554284b0f7f3e2/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:03.963791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c15f-ed9e-40f4-b6bd-9cb7de34a931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d1e269d5064ed1826fe15fa7e92c0f, user_id=50571e27460341d58d554284b0f7f3e2, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:03.966819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c15f-ed9e-40f4-b6bd-9cb7de34a931 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:03.998036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 877/1750] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:03 2022] PUT /identity/v3/projects/33d1e269d5064ed1826fe15fa7e92c0f/users/50571e27460341d58d554284b0f7f3e2/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:03.999315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c15f-ed9e-40f4-b6bd-9cb7de34a931 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:04.021115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-33c3c15f-ed9e-40f4-b6bd-9cb7de34a931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:04.091875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:04.096264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50d292-439b-4bbb-bd67-57646810b455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:04.111794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50d292-439b-4bbb-bd67-57646810b455 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:04.158765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 874/1751] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:04.165109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2ab6f-019b-4346-8d4c-c5081be731ad None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:04.166539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2ab6f-019b-4346-8d4c-c5081be731ad None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:04.168267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2ab6f-019b-4346-8d4c-c5081be731ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:04.236690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:04.236883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-98f2ab6f-019b-4346-8d4c-c5081be731ad None None] MFA Rules not processed for user `7be58892888f468d9caaeec9f02c5fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:04.242099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-98f2ab6f-019b-4346-8d4c-c5081be731ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:04.329870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c15f-ed9e-40f4-b6bd-9cb7de34a931 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:04.366978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79241c0-e256-40b7-9efe-0c74995d8071 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:04.367666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79241c0-e256-40b7-9efe-0c74995d8071 service swift] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:04.367973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79241c0-e256-40b7-9efe-0c74995d8071 service swift] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:04.368229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79241c0-e256-40b7-9efe-0c74995d8071 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:04.525602 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 875/1752] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:04.527517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33a48c-a698-452d-92b8-3e530516dfbf None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:04.528956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33a48c-a698-452d-92b8-3e530516dfbf None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:04.530539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33a48c-a698-452d-92b8-3e530516dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:04.623263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2a33a48c-a698-452d-92b8-3e530516dfbf None None] MFA Rules not processed for user `50571e27460341d58d554284b0f7f3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:04.629308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2a33a48c-a698-452d-92b8-3e530516dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:04.686371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79241c0-e256-40b7-9efe-0c74995d8071 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:04.687989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79241c0-e256-40b7-9efe-0c74995d8071 service swift] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:04.727450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 878/1753] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:36:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:36:04.728345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79241c0-e256-40b7-9efe-0c74995d8071 service swift] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:04.737064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d79241c0-e256-40b7-9efe-0c74995d8071 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:04.899412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 876/1754] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:05.020593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79241c0-e256-40b7-9efe-0c74995d8071 service swift] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:05.046002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17332a1-fbba-4838-bc3d-6684ba5e8fdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:05.046905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17332a1-fbba-4838-bc3d-6684ba5e8fdc service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:05.047337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17332a1-fbba-4838-bc3d-6684ba5e8fdc service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:05.048611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17332a1-fbba-4838-bc3d-6684ba5e8fdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:05.049543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33a48c-a698-452d-92b8-3e530516dfbf None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:05.050763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2a33a48c-a698-452d-92b8-3e530516dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:05.067973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17332a1-fbba-4838-bc3d-6684ba5e8fdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:05.077195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17332a1-fbba-4838-bc3d-6684ba5e8fdc service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:05.111739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 879/1755] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:05.205470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33a48c-a698-452d-92b8-3e530516dfbf None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:05.215144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989aeeef-d0fc-42bd-a4ca-a6d375980615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:05.221583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aeeef-d0fc-42bd-a4ca-a6d375980615 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:05.223100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aeeef-d0fc-42bd-a4ca-a6d375980615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:05.224475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989aeeef-d0fc-42bd-a4ca-a6d375980615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:05.289056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989aeeef-d0fc-42bd-a4ca-a6d375980615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:05.290436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989aeeef-d0fc-42bd-a4ca-a6d375980615 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:05.325109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 877/1756] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:05.734266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17332a1-fbba-4838-bc3d-6684ba5e8fdc service nova] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:05.750815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17332a1-fbba-4838-bc3d-6684ba5e8fdc service nova] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:05.758310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f4af-eed2-4c38-b36e-f027f758a34b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:05.758956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f4af-eed2-4c38-b36e-f027f758a34b service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:05.759237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f4af-eed2-4c38-b36e-f027f758a34b service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:05.759511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f4af-eed2-4c38-b36e-f027f758a34b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:05.885567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63f4af-eed2-4c38-b36e-f027f758a34b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:05.887066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63f4af-eed2-4c38-b36e-f027f758a34b service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:05.905765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 880/1757] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:05.983525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa01201-4b58-4101-b14c-a0a183bd17e2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:05.984166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa01201-4b58-4101-b14c-a0a183bd17e2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:05.984166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa01201-4b58-4101-b14c-a0a183bd17e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:06.045233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-efa01201-4b58-4101-b14c-a0a183bd17e2 None None] MFA Rules not processed for user `a1631559d5194f1fa449a16f93546349`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:06.050815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-efa01201-4b58-4101-b14c-a0a183bd17e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:06.120680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:06.208316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 878/1758] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:06.762571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f4af-eed2-4c38-b36e-f027f758a34b service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:06.791200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:06.874794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa01201-4b58-4101-b14c-a0a183bd17e2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:07.081182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f4af-eed2-4c38-b36e-f027f758a34b service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:07.108533 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:07.109563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.112508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:07.112954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] PATH_INFO: `/v3/users/075d4bca70fc4743869f177018065219` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:07.124071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=075d4bca70fc4743869f177018065219)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:07.132819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:07.137219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa01201-4b58-4101-b14c-a0a183bd17e2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:07.150671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:07.152093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.152526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:07.152961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] PATH_INFO: `/v3/users/af09bdf1242d43f1804ababa1af44376` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:07.155163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af09bdf1242d43f1804ababa1af44376)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:07.157366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:07.297846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af09bdf1242d43f1804ababa1af44376'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.319965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af09bdf1242d43f1804ababa1af44376'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.340383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075d4bca70fc4743869f177018065219'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.341220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af09bdf1242d43f1804ababa1af44376'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.341989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af09bdf1242d43f1804ababa1af44376'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.348945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0c61cfe5-29db-44cd-9286-6dad9642093c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af09bdf1242d43f1804ababa1af44376'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.360366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075d4bca70fc4743869f177018065219'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.375601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075d4bca70fc4743869f177018065219'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.376939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075d4bca70fc4743869f177018065219'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.419357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6448d858-026d-4027-8b52-0397aa6d4272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075d4bca70fc4743869f177018065219'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:07.429096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 879/1759] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:06 2022] DELETE /identity/v3/users/af09bdf1242d43f1804ababa1af44376 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:07.443195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d40c7-4b2f-4cfc-9f43-bab5a932763d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.443724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d40c7-4b2f-4cfc-9f43-bab5a932763d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:07.444165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d40c7-4b2f-4cfc-9f43-bab5a932763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:07.446425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 881/1760] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:06 2022] DELETE /identity/v3/users/075d4bca70fc4743869f177018065219 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:07.458353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87628d9f-fc29-478c-8bc9-2f4aefaba1f6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.458353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87628d9f-fc29-478c-8bc9-2f4aefaba1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:07.458353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87628d9f-fc29-478c-8bc9-2f4aefaba1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:07.540646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-87628d9f-fc29-478c-8bc9-2f4aefaba1f6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:07.541957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-246d40c7-4b2f-4cfc-9f43-bab5a932763d None None] MFA Rules not processed for user `d110c27fc9c045ea9a4eb49b4dafe221`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:07.542099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-87628d9f-fc29-478c-8bc9-2f4aefaba1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:07.545072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-246d40c7-4b2f-4cfc-9f43-bab5a932763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:07.779491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 880/1761] 10.222.0.71 () {58 vars in 1015 bytes} [Thu Aug 4 02:36:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:07.783860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 882/1762] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:07.790727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b22c4d-4eac-4844-9d3c-1cf93225525d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.793618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b22c4d-4eac-4844-9d3c-1cf93225525d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:07.793735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66759dc-08ad-4405-a04d-0670eb9644ab None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.794264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b22c4d-4eac-4844-9d3c-1cf93225525d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:07.795928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66759dc-08ad-4405-a04d-0670eb9644ab None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:07.796578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66759dc-08ad-4405-a04d-0670eb9644ab None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:07.800404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 883/1763] 10.222.0.69 () {54 vars in 912 bytes} [Thu Aug 4 02:36:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:07.809997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c245f0-9ff1-4d79-9551-c75edd948d5a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.810464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c245f0-9ff1-4d79-9551-c75edd948d5a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:07.811090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c245f0-9ff1-4d79-9551-c75edd948d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:07.825005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:07.841733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-58c245f0-9ff1-4d79-9551-c75edd948d5a None None] MFA Rules not processed for user `d110c27fc9c045ea9a4eb49b4dafe221`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:07.843096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-58c245f0-9ff1-4d79-9551-c75edd948d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:07.857870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 884/1764] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:36:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:07.858749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c245f0-9ff1-4d79-9551-c75edd948d5a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:07.860054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-58c245f0-9ff1-4d79-9551-c75edd948d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:07.872684 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-77b22c4d-4eac-4844-9d3c-1cf93225525d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:07.874576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-77b22c4d-4eac-4844-9d3c-1cf93225525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:07.906883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c245f0-9ff1-4d79-9551-c75edd948d5a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:07.911241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 881/1765] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:07.912591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b22c4d-4eac-4844-9d3c-1cf93225525d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:07.929906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420c108-1201-4f33-88ac-977706cecfcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:07.930756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420c108-1201-4f33-88ac-977706cecfcf service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.931195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420c108-1201-4f33-88ac-977706cecfcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:07.932015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420c108-1201-4f33-88ac-977706cecfcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:07.934513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b22c4d-4eac-4844-9d3c-1cf93225525d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:07.947842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae9af-2ef0-4f58-afd3-e5021f59bbb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:07.948698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420c108-1201-4f33-88ac-977706cecfcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:07.950351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae9af-2ef0-4f58-afd3-e5021f59bbb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.950672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420c108-1201-4f33-88ac-977706cecfcf service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:07.963476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae9af-2ef0-4f58-afd3-e5021f59bbb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:07.963989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 885/1766] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:07.965100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420c108-1201-4f33-88ac-977706cecfcf service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:07.965759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae9af-2ef0-4f58-afd3-e5021f59bbb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:07.966947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1420c108-1201-4f33-88ac-977706cecfcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:07.983830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420c108-1201-4f33-88ac-977706cecfcf service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:07.990013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa2180-43ab-4fb8-a5c3-e58d018143d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:07.990724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae9af-2ef0-4f58-afd3-e5021f59bbb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:07.991513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa2180-43ab-4fb8-a5c3-e58d018143d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:07.996948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae9af-2ef0-4f58-afd3-e5021f59bbb0 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:08.004972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa2180-43ab-4fb8-a5c3-e58d018143d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:08.005627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa2180-43ab-4fb8-a5c3-e58d018143d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:08.019770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 882/1767] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:08.020856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae9af-2ef0-4f58-afd3-e5021f59bbb0 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:08.031746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa2180-43ab-4fb8-a5c3-e58d018143d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:08.033091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae9af-2ef0-4f58-afd3-e5021f59bbb0 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:08.033758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa2180-43ab-4fb8-a5c3-e58d018143d7 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:08.037670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4a2cb-7a8f-427f-acbf-d83b9e5cb0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:08.038961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4a2cb-7a8f-427f-acbf-d83b9e5cb0ff service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:08.039313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4a2cb-7a8f-427f-acbf-d83b9e5cb0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:08.039650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4a2cb-7a8f-427f-acbf-d83b9e5cb0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:08.047264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:08.056041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4a2cb-7a8f-427f-acbf-d83b9e5cb0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:08.060310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4a2cb-7a8f-427f-acbf-d83b9e5cb0ff service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:08.077131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 886/1768] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:08.084689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 883/1769] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:09.841443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fddcd-20bc-4cee-8dde-97d476c0aa71 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:09.842359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fddcd-20bc-4cee-8dde-97d476c0aa71 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:09.842798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fddcd-20bc-4cee-8dde-97d476c0aa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:09.879541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-425fddcd-20bc-4cee-8dde-97d476c0aa71 None None] MFA Rules not processed for user `7be58892888f468d9caaeec9f02c5fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:09.892277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-425fddcd-20bc-4cee-8dde-97d476c0aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:10.095292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce85cd-403d-459a-bdea-0fe5736a5ad2 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:10.096200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce85cd-403d-459a-bdea-0fe5736a5ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:10.096618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce85cd-403d-459a-bdea-0fe5736a5ad2 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:10.098498 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 884/1770] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:10.160602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 887/1771] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:10.214725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce85cd-403d-459a-bdea-0fe5736a5ad2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:10.216603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-51ce85cd-403d-459a-bdea-0fe5736a5ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:10.244157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce85cd-403d-459a-bdea-0fe5736a5ad2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:10.262075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:10.262754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:10.263033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:10.263320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] PATH_INFO: `/v3/users/b9044ae1b4c94008ac8c63a84fa1035c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:10.266629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9044ae1b4c94008ac8c63a84fa1035c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:10.274363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:10.277206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fddcd-20bc-4cee-8dde-97d476c0aa71 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:10.278638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-425fddcd-20bc-4cee-8dde-97d476c0aa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:10.307350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fddcd-20bc-4cee-8dde-97d476c0aa71 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:10.329269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:10.331213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:10.331520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:10.332017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] PATH_INFO: `/v3/users/fd7acc25d51f40e69a7772b304b15cb8` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:10.335183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7acc25d51f40e69a7772b304b15cb8)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:10.340154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:10.450486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9044ae1b4c94008ac8c63a84fa1035c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.470965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7acc25d51f40e69a7772b304b15cb8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.471990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9044ae1b4c94008ac8c63a84fa1035c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.508128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7acc25d51f40e69a7772b304b15cb8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.516949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7acc25d51f40e69a7772b304b15cb8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.517899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9044ae1b4c94008ac8c63a84fa1035c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.518645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7acc25d51f40e69a7772b304b15cb8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.518993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9044ae1b4c94008ac8c63a84fa1035c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.519776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ba3392e4-5a6b-44dd-9110-2a3991f4c9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9044ae1b4c94008ac8c63a84fa1035c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.586477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-71533cfc-dc61-44b2-a79a-30e44efbfac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7acc25d51f40e69a7772b304b15cb8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:10.602491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 885/1772] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:10 2022] DELETE /identity/v3/users/b9044ae1b4c94008ac8c63a84fa1035c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:10.602491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc0555-a7c5-4ea5-9814-5530d4b198b9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:10.602491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc0555-a7c5-4ea5-9814-5530d4b198b9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:10.602491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc0555-a7c5-4ea5-9814-5530d4b198b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:10.617364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 888/1773] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:10 2022] DELETE /identity/v3/users/fd7acc25d51f40e69a7772b304b15cb8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:10.624803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2c29-c68b-4ea6-b3df-de974a99ff0b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:10.625176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2c29-c68b-4ea6-b3df-de974a99ff0b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:10.625506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2c29-c68b-4ea6-b3df-de974a99ff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:10.666416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-61dc0555-a7c5-4ea5-9814-5530d4b198b9 None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:10.668320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-61dc0555-a7c5-4ea5-9814-5530d4b198b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:10.709287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-d3af2c29-c68b-4ea6-b3df-de974a99ff0b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:10.719477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d3af2c29-c68b-4ea6-b3df-de974a99ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:10.891122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 886/1774] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:10.898327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 889/1775] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:10.904296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd60eb-30b2-428d-a40b-fb9a5b06f797 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:10.904771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd60eb-30b2-428d-a40b-fb9a5b06f797 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:10.905196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd60eb-30b2-428d-a40b-fb9a5b06f797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:10.909658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af2c29-c68b-4ea6-b3df-de974a99ff0b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:10.911124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d3af2c29-c68b-4ea6-b3df-de974a99ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:10.927764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e5fd60eb-30b2-428d-a40b-fb9a5b06f797 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:10.929240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e5fd60eb-30b2-428d-a40b-fb9a5b06f797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:10.935435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:10.956937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 887/1776] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:10.967573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd60eb-30b2-428d-a40b-fb9a5b06f797 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:10.971195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e5fd60eb-30b2-428d-a40b-fb9a5b06f797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:11.053047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af2c29-c68b-4ea6-b3df-de974a99ff0b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:11.061561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:11.062322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423ddc-6a6c-4343-8c94-8582d6c587ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:11.062979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423ddc-6a6c-4343-8c94-8582d6c587ff service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:11.063253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423ddc-6a6c-4343-8c94-8582d6c587ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:11.063520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423ddc-6a6c-4343-8c94-8582d6c587ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:11.090892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58423ddc-6a6c-4343-8c94-8582d6c587ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:11.092255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58423ddc-6a6c-4343-8c94-8582d6c587ff service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:11.161760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 890/1777] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:11.195335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd60eb-30b2-428d-a40b-fb9a5b06f797 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:11.205310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570b34f-6278-43a7-8792-e2407ea40fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:11.206748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b34f-6278-43a7-8792-e2407ea40fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:11.207384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b34f-6278-43a7-8792-e2407ea40fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:11.207913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570b34f-6278-43a7-8792-e2407ea40fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:11.229845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570b34f-6278-43a7-8792-e2407ea40fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:11.231735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570b34f-6278-43a7-8792-e2407ea40fe4 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:11.248765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 888/1778] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:11.277796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423ddc-6a6c-4343-8c94-8582d6c587ff service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:11.279486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-58423ddc-6a6c-4343-8c94-8582d6c587ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:11.311360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423ddc-6a6c-4343-8c94-8582d6c587ff service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:11.327425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb35951-b2dd-4443-9177-f0e2ac7c4947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:11.328336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb35951-b2dd-4443-9177-f0e2ac7c4947 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:11.328769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb35951-b2dd-4443-9177-f0e2ac7c4947 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:11.329192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb35951-b2dd-4443-9177-f0e2ac7c4947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:11.350746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb35951-b2dd-4443-9177-f0e2ac7c4947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:11.353946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb35951-b2dd-4443-9177-f0e2ac7c4947 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:11.390308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 891/1779] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:12.087253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570b34f-6278-43a7-8792-e2407ea40fe4 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:12.089073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8570b34f-6278-43a7-8792-e2407ea40fe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:12.112737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570b34f-6278-43a7-8792-e2407ea40fe4 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:12.140947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:12.140947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:12.140947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:12.140947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] PATH_INFO: `/v3/projects/5c8833e93aa84c07aee8b90b14a2c2d2` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:12.142519 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c8833e93aa84c07aee8b90b14a2c2d2)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:12.146345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:12.203620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb35951-b2dd-4443-9177-f0e2ac7c4947 service nova] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:12.205263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0cb35951-b2dd-4443-9177-f0e2ac7c4947 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:12.248063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb35951-b2dd-4443-9177-f0e2ac7c4947 service nova] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:12.267182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:12.269791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:12.270182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:12.270638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] PATH_INFO: `/v3/projects/5b6902135b474f42803faa3f32c2966e` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:12.273639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6902135b474f42803faa3f32c2966e)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:12.277994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:12.293910 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c8833e93aa84c07aee8b90b14a2c2d2', 'request_id': 'req-369bcca8-60e9-4543-9930-70b6e677da89'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.311172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c8833e93aa84c07aee8b90b14a2c2d2', 'request_id': 'req-369bcca8-60e9-4543-9930-70b6e677da89'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.322252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c8833e93aa84c07aee8b90b14a2c2d2', 'request_id': 'req-369bcca8-60e9-4543-9930-70b6e677da89'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.350108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] The token cache is being invalidate because project 5c8833e93aa84c07aee8b90b14a2c2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:12.350585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.351720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.361373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 889/1780] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:12 2022] DELETE /identity/v3/projects/5c8833e93aa84c07aee8b90b14a2c2d2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:12.365857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:12.369234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:12.396553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6902135b474f42803faa3f32c2966e', 'request_id': 'req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.421500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6902135b474f42803faa3f32c2966e', 'request_id': 'req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.434005 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6902135b474f42803faa3f32c2966e', 'request_id': 'req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.460178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] The token cache is being invalidate because project 5b6902135b474f42803faa3f32c2966e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:12.462470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.464293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.470756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 892/1781] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:12 2022] DELETE /identity/v3/projects/5b6902135b474f42803faa3f32c2966e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:12.471718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:12.474124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:12.535798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bcca8-60e9-4543-9930-70b6e677da89 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:12.626530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3a4a9-f1ac-4a47-b893-2759fb56da29 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:12.634626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:12.636024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:12.636755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:12.637242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] PATH_INFO: `/v3/users/66fa031db58641e6850f2f551af2d4b7` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:12.638762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66fa031db58641e6850f2f551af2d4b7)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:12.641677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:12.669776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:12.670520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:12.670784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:12.671066 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] PATH_INFO: `/v3/users/c671a130533045f89a103fbb3368b768` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:12.673526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c671a130533045f89a103fbb3368b768)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:12.675504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:12.682733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:12.713051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:12.750949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fa031db58641e6850f2f551af2d4b7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.769809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fa031db58641e6850f2f551af2d4b7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.790284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c671a130533045f89a103fbb3368b768'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.801608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fa031db58641e6850f2f551af2d4b7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.803171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fa031db58641e6850f2f551af2d4b7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.825668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c671a130533045f89a103fbb3368b768'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.856768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c671a130533045f89a103fbb3368b768'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.857912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c671a130533045f89a103fbb3368b768'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.859847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c671a130533045f89a103fbb3368b768'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.861990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fa031db58641e6850f2f551af2d4b7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:12.890752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 893/1782] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:12 2022] DELETE /identity/v3/users/66fa031db58641e6850f2f551af2d4b7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:12.934605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 890/1783] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:12 2022] DELETE /identity/v3/users/c671a130533045f89a103fbb3368b768 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:13.583264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:13.586105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:13.861543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ba284-58c0-40d8-9bff-62e4ad534a15 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:14.135037 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:14.139002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:14.142924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:14.143252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] PATH_INFO: `/v3/projects/b135741af711474f93e5f06e894ea8b6` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:14.146902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b135741af711474f93e5f06e894ea8b6)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:14.157353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:14.348117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b135741af711474f93e5f06e894ea8b6', 'request_id': 'req-9395d363-c4f5-45a6-800d-04e9d4ab13ab'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:14.366247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b135741af711474f93e5f06e894ea8b6', 'request_id': 'req-9395d363-c4f5-45a6-800d-04e9d4ab13ab'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:14.369178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:14.377956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b135741af711474f93e5f06e894ea8b6', 'request_id': 'req-9395d363-c4f5-45a6-800d-04e9d4ab13ab'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:14.403891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] The token cache is being invalidate because project b135741af711474f93e5f06e894ea8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:14.404246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:14.413474 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:14.417970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 894/1784] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:13 2022] DELETE /identity/v3/projects/b135741af711474f93e5f06e894ea8b6 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:14.422460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:14.424587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:14.453162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec328e3-6667-466d-ae16-2478f578b36b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:14.632059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:14.638818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:14.640254 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:14.641613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] PATH_INFO: `/v3/users/d23b258c9d024fd499ebda3d22d26895` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:14.645023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23b258c9d024fd499ebda3d22d26895)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:14.663892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:14.669727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:14.671179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:14.706055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395d363-c4f5-45a6-800d-04e9d4ab13ab admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:14.732373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:14.735234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:14.735899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:14.738155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] PATH_INFO: `/v3/projects/15a8738d93864d8481b83760857829ad` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:14.744323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a8738d93864d8481b83760857829ad)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:14.754834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:14.898890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23b258c9d024fd499ebda3d22d26895'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:14.924033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23b258c9d024fd499ebda3d22d26895'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:14.963176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23b258c9d024fd499ebda3d22d26895'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:14.967679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23b258c9d024fd499ebda3d22d26895'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:14.972561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23b258c9d024fd499ebda3d22d26895'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.030277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:15.047438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a8738d93864d8481b83760857829ad', 'request_id': 'req-d933b637-2227-4039-9583-8f5c1cfe8dfc'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.048565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 891/1785] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:14 2022] DELETE /identity/v3/users/d23b258c9d024fd499ebda3d22d26895 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:15.079362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a8738d93864d8481b83760857829ad', 'request_id': 'req-d933b637-2227-4039-9583-8f5c1cfe8dfc'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.123272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a8738d93864d8481b83760857829ad', 'request_id': 'req-d933b637-2227-4039-9583-8f5c1cfe8dfc'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.185894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] The token cache is being invalidate because project 15a8738d93864d8481b83760857829ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:15.186839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.190593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.203599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 895/1786] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:14 2022] DELETE /identity/v3/projects/15a8738d93864d8481b83760857829ad => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:15.204775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:15.206879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:15.487165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a441a9e-57ca-4eef-92ab-b5c17ea7e88f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:15.515736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:15.516420 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:15.516716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:15.517791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] PATH_INFO: `/v3/users/50571e27460341d58d554284b0f7f3e2` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:15.530810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50571e27460341d58d554284b0f7f3e2)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:15.542930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:15.727237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50571e27460341d58d554284b0f7f3e2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.739405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50571e27460341d58d554284b0f7f3e2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.750730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50571e27460341d58d554284b0f7f3e2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.751567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50571e27460341d58d554284b0f7f3e2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.752504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50571e27460341d58d554284b0f7f3e2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:15.781298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 892/1787] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:15 2022] DELETE /identity/v3/users/50571e27460341d58d554284b0f7f3e2 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:16.186399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:16.188143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:16.406534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933b637-2227-4039-9583-8f5c1cfe8dfc admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:16.523298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:16.525086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:16.577628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:16.577628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:16.577628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:16.577628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] PATH_INFO: `/v3/projects/20929e69a97647529b624165ea6c2733` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:16.578579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20929e69a97647529b624165ea6c2733)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:16.580647 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:16.618145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:16.672330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20929e69a97647529b624165ea6c2733', 'request_id': 'req-d344b892-bc69-42e0-b1e2-189f54ed089d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:16.686129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20929e69a97647529b624165ea6c2733', 'request_id': 'req-d344b892-bc69-42e0-b1e2-189f54ed089d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:16.705980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20929e69a97647529b624165ea6c2733', 'request_id': 'req-d344b892-bc69-42e0-b1e2-189f54ed089d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:16.721496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] The token cache is being invalidate because project 20929e69a97647529b624165ea6c2733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:16.722041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:16.723014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:16.726142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 896/1788] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:16 2022] DELETE /identity/v3/projects/20929e69a97647529b624165ea6c2733 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:16.727158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:16.729288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:16.731234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6aa23-e3e6-46b0-9f71-f34e7b3e7548 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:16.823760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:16.840961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344b892-bc69-42e0-b1e2-189f54ed089d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:16.848859 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:16.849944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:16.850474 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:16.850916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] PATH_INFO: `/v3/projects/87c6dbd8004643b7b8d0fa18a06a213f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:16.852403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c6dbd8004643b7b8d0fa18a06a213f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:16.856369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:16.902787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:16.903248 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:16.903534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:16.903811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] PATH_INFO: `/v3/projects/f331560caf78488398519f8580166e24` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:16.905794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f331560caf78488398519f8580166e24)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:16.907848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:16.994402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c6dbd8004643b7b8d0fa18a06a213f', 'request_id': 'req-a9c76643-5d67-41d4-b6e4-603a65791a56'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.027287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c6dbd8004643b7b8d0fa18a06a213f', 'request_id': 'req-a9c76643-5d67-41d4-b6e4-603a65791a56'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.033902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f331560caf78488398519f8580166e24', 'request_id': 'req-d9349455-d3a1-46f4-aed0-77130150df22'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.046601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f331560caf78488398519f8580166e24', 'request_id': 'req-d9349455-d3a1-46f4-aed0-77130150df22'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.053166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f331560caf78488398519f8580166e24', 'request_id': 'req-d9349455-d3a1-46f4-aed0-77130150df22'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.063412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c6dbd8004643b7b8d0fa18a06a213f', 'request_id': 'req-a9c76643-5d67-41d4-b6e4-603a65791a56'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.094106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] The token cache is being invalidate because project f331560caf78488398519f8580166e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:17.096294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.097475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9349455-d3a1-46f4-aed0-77130150df22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.106459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 893/1789] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:16 2022] DELETE /identity/v3/projects/f331560caf78488398519f8580166e24 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:17.108216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379c5f1-ccae-442e-b447-b5a31b59cc06 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.111645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379c5f1-ccae-442e-b447-b5a31b59cc06 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.112210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379c5f1-ccae-442e-b447-b5a31b59cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.118497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] The token cache is being invalidate because project 87c6dbd8004643b7b8d0fa18a06a213f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:17.118839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.121618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9c76643-5d67-41d4-b6e4-603a65791a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:17.125624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 897/1790] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:16 2022] DELETE /identity/v3/projects/87c6dbd8004643b7b8d0fa18a06a213f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:17.128474 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403b4e-beef-4034-bcfc-557bb3cfe9d8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.131588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403b4e-beef-4034-bcfc-557bb3cfe9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.131878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22403b4e-beef-4034-bcfc-557bb3cfe9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.168456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d379c5f1-ccae-442e-b447-b5a31b59cc06 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:17.170414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d379c5f1-ccae-442e-b447-b5a31b59cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:17.208382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-22403b4e-beef-4034-bcfc-557bb3cfe9d8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:17.220319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-22403b4e-beef-4034-bcfc-557bb3cfe9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:17.378920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:17.379366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 894/1791] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:17.380669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6c650-9e0f-484e-9fbc-bccb0724b487 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.380966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6c650-9e0f-484e-9fbc-bccb0724b487 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.381240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6c650-9e0f-484e-9fbc-bccb0724b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.430385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-29e6c650-9e0f-484e-9fbc-bccb0724b487 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:17.431672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-29e6c650-9e0f-484e-9fbc-bccb0724b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:17.462170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 895/1792] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:17.463412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafa0d4-8f0b-483e-8ec6-8979899677fe None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.463753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafa0d4-8f0b-483e-8ec6-8979899677fe None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.463980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafa0d4-8f0b-483e-8ec6-8979899677fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.473872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 898/1793] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:17.475542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926e6bd-a65f-49b0-8229-828a12f949a2 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.475628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926e6bd-a65f-49b0-8229-828a12f949a2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.476024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926e6bd-a65f-49b0-8229-828a12f949a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.509305 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bfafa0d4-8f0b-483e-8ec6-8979899677fe None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:17.511030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bfafa0d4-8f0b-483e-8ec6-8979899677fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:17.531162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 896/1794] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:17.533488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772944-2e3f-4dd8-b528-38f267a0ded7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.533927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772944-2e3f-4dd8-b528-38f267a0ded7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.534932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772944-2e3f-4dd8-b528-38f267a0ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.564769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8926e6bd-a65f-49b0-8229-828a12f949a2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:17.575676 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8926e6bd-a65f-49b0-8229-828a12f949a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:17.600638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 899/1795] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:17.605454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926e6bd-a65f-49b0-8229-828a12f949a2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:17.632006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926e6bd-a65f-49b0-8229-828a12f949a2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:17.634577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bc772944-2e3f-4dd8-b528-38f267a0ded7 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:17.635941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bc772944-2e3f-4dd8-b528-38f267a0ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:17.644023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a0dd3-cc0a-4315-afa5-9ce217457662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:17.644571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a0dd3-cc0a-4315-afa5-9ce217457662 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.644880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a0dd3-cc0a-4315-afa5-9ce217457662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.645113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a0dd3-cc0a-4315-afa5-9ce217457662 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.645923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a0dd3-cc0a-4315-afa5-9ce217457662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:17.646625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a0dd3-cc0a-4315-afa5-9ce217457662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:17.648857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a0dd3-cc0a-4315-afa5-9ce217457662 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:17.664326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 897/1797] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:17.665242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772944-2e3f-4dd8-b528-38f267a0ded7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:17.672919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 900/1797] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:17.674093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a0dd3-cc0a-4315-afa5-9ce217457662 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:17.686966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a0dd3-cc0a-4315-afa5-9ce217457662 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:17.692784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3001a-7610-41ed-9e69-59d02c905f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:17.693306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772944-2e3f-4dd8-b528-38f267a0ded7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:17.693464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3001a-7610-41ed-9e69-59d02c905f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.693724 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3001a-7610-41ed-9e69-59d02c905f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.693998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3001a-7610-41ed-9e69-59d02c905f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.694939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3001a-7610-41ed-9e69-59d02c905f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:17.695285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3001a-7610-41ed-9e69-59d02c905f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:17.697534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3001a-7610-41ed-9e69-59d02c905f5e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:17.713978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fa137-f8ff-4809-b3bd-bdd41ca08ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:17.715144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fa137-f8ff-4809-b3bd-bdd41ca08ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.715643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fa137-f8ff-4809-b3bd-bdd41ca08ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.716109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fa137-f8ff-4809-b3bd-bdd41ca08ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.717050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fa137-f8ff-4809-b3bd-bdd41ca08ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:17.719805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fa137-f8ff-4809-b3bd-bdd41ca08ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:17.723472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 901/1798] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:17.724325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3001a-7610-41ed-9e69-59d02c905f5e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:17.732074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fa137-f8ff-4809-b3bd-bdd41ca08ee1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:17.752563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3001a-7610-41ed-9e69-59d02c905f5e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:17.776846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686c2e-9e42-4395-960e-81b559dbe2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:17.778087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686c2e-9e42-4395-960e-81b559dbe2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.778769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686c2e-9e42-4395-960e-81b559dbe2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.779318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19686c2e-9e42-4395-960e-81b559dbe2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.780066 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 898/1799] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:17.784706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19686c2e-9e42-4395-960e-81b559dbe2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:17.785764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fa137-f8ff-4809-b3bd-bdd41ca08ee1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:17.788274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19686c2e-9e42-4395-960e-81b559dbe2b8 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:17.820580 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fa137-f8ff-4809-b3bd-bdd41ca08ee1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:17.843488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555d709-3e90-4345-8f82-601cf1c3f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:17.844385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555d709-3e90-4345-8f82-601cf1c3f37e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:17.844908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555d709-3e90-4345-8f82-601cf1c3f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:17.854937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555d709-3e90-4345-8f82-601cf1c3f37e admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:17.857558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555d709-3e90-4345-8f82-601cf1c3f37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:17.861228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555d709-3e90-4345-8f82-601cf1c3f37e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:17.875752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 902/1800] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:17.875752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686c2e-9e42-4395-960e-81b559dbe2b8 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:17.910872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:17.923700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 899/1801] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:17.933925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555d709-3e90-4345-8f82-601cf1c3f37e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.071150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19686c2e-9e42-4395-960e-81b559dbe2b8 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.111342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555d709-3e90-4345-8f82-601cf1c3f37e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.122169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f64968-c460-4ba1-bbdb-4d1f167ec7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.122914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64968-c460-4ba1-bbdb-4d1f167ec7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.123267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64968-c460-4ba1-bbdb-4d1f167ec7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.123659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64968-c460-4ba1-bbdb-4d1f167ec7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.124594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f64968-c460-4ba1-bbdb-4d1f167ec7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.128439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f64968-c460-4ba1-bbdb-4d1f167ec7e6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.170899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0240c-6072-4541-8ddc-650349a8b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.177378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0240c-6072-4541-8ddc-650349a8b8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.179269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0240c-6072-4541-8ddc-650349a8b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.179606 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0240c-6072-4541-8ddc-650349a8b8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.180321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0240c-6072-4541-8ddc-650349a8b8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.183293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0240c-6072-4541-8ddc-650349a8b8f6 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.192746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 900/1802] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:18.202048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed503f51-69e1-4977-a152-9e608ab7ca3d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.202421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed503f51-69e1-4977-a152-9e608ab7ca3d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.202799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed503f51-69e1-4977-a152-9e608ab7ca3d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.209433 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 901/1803] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:36:18 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:18.210405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed503f51-69e1-4977-a152-9e608ab7ca3d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.227187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 903/1804] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:17 2022] POST /identity/v3/projects => generated 375 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:18.234523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0240c-6072-4541-8ddc-650349a8b8f6 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.264149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:18.367391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed503f51-69e1-4977-a152-9e608ab7ca3d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.388024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0240c-6072-4541-8ddc-650349a8b8f6 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.403511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649feae6-3f4f-4b7c-88f5-3361bf516acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.403511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649feae6-3f4f-4b7c-88f5-3361bf516acb admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.403511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649feae6-3f4f-4b7c-88f5-3361bf516acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.403511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649feae6-3f4f-4b7c-88f5-3361bf516acb admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.404273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649feae6-3f4f-4b7c-88f5-3361bf516acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.406437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649feae6-3f4f-4b7c-88f5-3361bf516acb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.419464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0e6a2-c1bb-4706-a566-b323469c9237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.420166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e6a2-c1bb-4706-a566-b323469c9237 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.420453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e6a2-c1bb-4706-a566-b323469c9237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.420727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e6a2-c1bb-4706-a566-b323469c9237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.424633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0e6a2-c1bb-4706-a566-b323469c9237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.426333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0e6a2-c1bb-4706-a566-b323469c9237 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.456967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 904/1805] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:18.458663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0e6a2-c1bb-4706-a566-b323469c9237 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.473123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0e6a2-c1bb-4706-a566-b323469c9237 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.479635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 902/1806] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:18 2022] POST /identity/v3/users => generated 285 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:18.482294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f284-e60d-4869-bebe-eac5f5198bba None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.484674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a007119-72b8-4606-a936-7e4f8470ebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.485517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a007119-72b8-4606-a936-7e4f8470ebff admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.485806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a007119-72b8-4606-a936-7e4f8470ebff admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.485958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f284-e60d-4869-bebe-eac5f5198bba None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.486129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a007119-72b8-4606-a936-7e4f8470ebff admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.486231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f284-e60d-4869-bebe-eac5f5198bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.486742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a007119-72b8-4606-a936-7e4f8470ebff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.490902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a007119-72b8-4606-a936-7e4f8470ebff admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.538176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2ef0f284-e60d-4869-bebe-eac5f5198bba None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:18.540036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2ef0f284-e60d-4869-bebe-eac5f5198bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:18.540920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 905/1807] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:18 2022] POST /identity/v3/users => generated 288 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:18.542315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a007119-72b8-4606-a936-7e4f8470ebff admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.565932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a007119-72b8-4606-a936-7e4f8470ebff admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.577024 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415419-e286-46a2-bef6-65ab0a41fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.577705 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415419-e286-46a2-bef6-65ab0a41fa69 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.577986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415419-e286-46a2-bef6-65ab0a41fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.578258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415419-e286-46a2-bef6-65ab0a41fa69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.578952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb415419-e286-46a2-bef6-65ab0a41fa69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.580663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb415419-e286-46a2-bef6-65ab0a41fa69 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.608401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 906/1808] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:18.608401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415419-e286-46a2-bef6-65ab0a41fa69 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.633234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415419-e286-46a2-bef6-65ab0a41fa69 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.645614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42697c9-2558-4b98-959c-349371ce4175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.646245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42697c9-2558-4b98-959c-349371ce4175 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.646929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42697c9-2558-4b98-959c-349371ce4175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.646929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42697c9-2558-4b98-959c-349371ce4175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.647471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42697c9-2558-4b98-959c-349371ce4175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.651757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42697c9-2558-4b98-959c-349371ce4175 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.679030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 907/1809] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:18.681043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42697c9-2558-4b98-959c-349371ce4175 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.684900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f42697c9-2558-4b98-959c-349371ce4175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:18.708914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42697c9-2558-4b98-959c-349371ce4175 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.714962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 903/1810] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:36:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:18.715969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0f284-e60d-4869-bebe-eac5f5198bba None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.727434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.728226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.728942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.728942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] PATH_INFO: `/v3/projects/33d1e269d5064ed1826fe15fa7e92c0f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.732400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d1e269d5064ed1826fe15fa7e92c0f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.735601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.750800 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0f284-e60d-4869-bebe-eac5f5198bba None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.757891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5f287-b8eb-4439-9c9d-178723796478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.758530 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5f287-b8eb-4439-9c9d-178723796478 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.758809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5f287-b8eb-4439-9c9d-178723796478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.759082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5f287-b8eb-4439-9c9d-178723796478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.759810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5f287-b8eb-4439-9c9d-178723796478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.762935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5f287-b8eb-4439-9c9d-178723796478 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.779174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:18.789720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 904/1811] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:18.790384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5f287-b8eb-4439-9c9d-178723796478 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.803447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d1e269d5064ed1826fe15fa7e92c0f', 'request_id': 'req-a4be9eca-3245-4f45-8571-0b19aa4e251d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:18.811839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5f287-b8eb-4439-9c9d-178723796478 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.815446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d1e269d5064ed1826fe15fa7e92c0f', 'request_id': 'req-a4be9eca-3245-4f45-8571-0b19aa4e251d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:18.829578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d1e269d5064ed1826fe15fa7e92c0f', 'request_id': 'req-a4be9eca-3245-4f45-8571-0b19aa4e251d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:18.861811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] The token cache is being invalidate because project 33d1e269d5064ed1826fe15fa7e92c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:18.862265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:18.865931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:18.869436 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 908/1812] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:18 2022] DELETE /identity/v3/projects/33d1e269d5064ed1826fe15fa7e92c0f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:18.870635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.872841 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:18.915241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a55f-0b7b-4c14-8aad-a21fc81c7dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:18.915668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a55f-0b7b-4c14-8aad-a21fc81c7dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:18.917526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a55f-0b7b-4c14-8aad-a21fc81c7dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:18.917901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a55f-0b7b-4c14-8aad-a21fc81c7dfb admin admin] PATH_INFO: `/v3/projects/c056cc76ecc9497d83076159faa96c6a/users/6b3d98df487140279f4b982c3b3e47d8/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:18.943845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a55f-0b7b-4c14-8aad-a21fc81c7dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c056cc76ecc9497d83076159faa96c6a, user_id=6b3d98df487140279f4b982c3b3e47d8, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:18.947094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a55f-0b7b-4c14-8aad-a21fc81c7dfb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:18.970017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:18.984682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9eca-3245-4f45-8571-0b19aa4e251d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:18.993501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 905/1813] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:18 2022] PUT /identity/v3/projects/c056cc76ecc9497d83076159faa96c6a/users/6b3d98df487140279f4b982c3b3e47d8/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:18.993501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a55f-0b7b-4c14-8aad-a21fc81c7dfb admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:18.995242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c003a55f-0b7b-4c14-8aad-a21fc81c7dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.086651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95155d1d-a2bb-4d0b-bcc5-8dbb8866d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.087789 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95155d1d-a2bb-4d0b-bcc5-8dbb8866d93f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.088309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95155d1d-a2bb-4d0b-bcc5-8dbb8866d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.089320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95155d1d-a2bb-4d0b-bcc5-8dbb8866d93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.090227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95155d1d-a2bb-4d0b-bcc5-8dbb8866d93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.092293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95155d1d-a2bb-4d0b-bcc5-8dbb8866d93f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.110342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a55f-0b7b-4c14-8aad-a21fc81c7dfb admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.116143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833185c-c5ee-43ff-9749-f35fadd6df97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.116815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833185c-c5ee-43ff-9749-f35fadd6df97 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.117100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833185c-c5ee-43ff-9749-f35fadd6df97 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.120379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 909/1814] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:19.120520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833185c-c5ee-43ff-9749-f35fadd6df97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.120605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95155d1d-a2bb-4d0b-bcc5-8dbb8866d93f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:19.120687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-95155d1d-a2bb-4d0b-bcc5-8dbb8866d93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.121629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0833185c-c5ee-43ff-9749-f35fadd6df97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.134431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95155d1d-a2bb-4d0b-bcc5-8dbb8866d93f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.136995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833185c-c5ee-43ff-9749-f35fadd6df97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.138943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833185c-c5ee-43ff-9749-f35fadd6df97 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.140235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897c3ed-063c-4af9-a142-52c9dce0b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.140889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897c3ed-063c-4af9-a142-52c9dce0b1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.141160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897c3ed-063c-4af9-a142-52c9dce0b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.141460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897c3ed-063c-4af9-a142-52c9dce0b1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.142155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897c3ed-063c-4af9-a142-52c9dce0b1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.143727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897c3ed-063c-4af9-a142-52c9dce0b1f9 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.151885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 906/1815] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:19.153165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f55f7-d41f-4ec2-8d7e-8ba0059e1688 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.153494 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f55f7-d41f-4ec2-8d7e-8ba0059e1688 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.153750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f55f7-d41f-4ec2-8d7e-8ba0059e1688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.170026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 910/1816] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:19.174164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89856a6c-a288-4e03-a067-8274b71135b7 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.174164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89856a6c-a288-4e03-a067-8274b71135b7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.174442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89856a6c-a288-4e03-a067-8274b71135b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.182148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d84f55f7-d41f-4ec2-8d7e-8ba0059e1688 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:19.183385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d84f55f7-d41f-4ec2-8d7e-8ba0059e1688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.209405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 907/1817] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:19.209405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f55f7-d41f-4ec2-8d7e-8ba0059e1688 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:19.227076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f55f7-d41f-4ec2-8d7e-8ba0059e1688 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.228360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-89856a6c-a288-4e03-a067-8274b71135b7 None None] MFA Rules not processed for user `6b3d98df487140279f4b982c3b3e47d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:19.229837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-89856a6c-a288-4e03-a067-8274b71135b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.236449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bb89-e68c-49a2-9908-c9b36e448948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.237808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bb89-e68c-49a2-9908-c9b36e448948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.238260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bb89-e68c-49a2-9908-c9b36e448948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.238419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bb89-e68c-49a2-9908-c9b36e448948 admin admin] PATH_INFO: `/v3/projects/c671f87cd9754f33b07a7db7e3673c56/users/2792fb8bfdaa4364913fddfa4702cb57/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.257583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8bb89-e68c-49a2-9908-c9b36e448948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c671f87cd9754f33b07a7db7e3673c56, user_id=2792fb8bfdaa4364913fddfa4702cb57, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.261056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8bb89-e68c-49a2-9908-c9b36e448948 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.280233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 908/1818] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:19 2022] PUT /identity/v3/projects/c671f87cd9754f33b07a7db7e3673c56/users/2792fb8bfdaa4364913fddfa4702cb57/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:19.281513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bb89-e68c-49a2-9908-c9b36e448948 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:19.330176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 911/1819] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:19.330176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5efc3b-aefa-4348-8162-f770126069fc None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.330176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5efc3b-aefa-4348-8162-f770126069fc None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.330176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5efc3b-aefa-4348-8162-f770126069fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.352003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:19.357876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8f5efc3b-aefa-4348-8162-f770126069fc None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:19.359736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8f5efc3b-aefa-4348-8162-f770126069fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.381145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bb89-e68c-49a2-9908-c9b36e448948 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.386976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f3a6a-1bec-499b-8461-107146e679cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.387790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f3a6a-1bec-499b-8461-107146e679cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.388072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f3a6a-1bec-499b-8461-107146e679cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.389969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f3a6a-1bec-499b-8461-107146e679cd admin admin] PATH_INFO: `/v3/projects/5252a286c3df4b829775ec0a4fe14698/users/bf8f853de116404dbc3af797fb2d45b8/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.412098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f3a6a-1bec-499b-8461-107146e679cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5252a286c3df4b829775ec0a4fe14698, user_id=bf8f853de116404dbc3af797fb2d45b8, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.416017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f3a6a-1bec-499b-8461-107146e679cd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.451133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 909/1820] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:19 2022] PUT /identity/v3/projects/5252a286c3df4b829775ec0a4fe14698/users/bf8f853de116404dbc3af797fb2d45b8/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:19.451133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94625a35-c41f-4c91-b60f-3d9033a84051 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.451133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94625a35-c41f-4c91-b60f-3d9033a84051 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.451133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94625a35-c41f-4c91-b60f-3d9033a84051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.454573 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 912/1821] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:19.455629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5efc3b-aefa-4348-8162-f770126069fc None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:19.458564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8f5efc3b-aefa-4348-8162-f770126069fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.477180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5efc3b-aefa-4348-8162-f770126069fc None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.495873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:19.524227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-94625a35-c41f-4c91-b60f-3d9033a84051 None None] MFA Rules not processed for user `2792fb8bfdaa4364913fddfa4702cb57`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:19.526553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-94625a35-c41f-4c91-b60f-3d9033a84051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.583171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccb795-a2a9-48b8-a58b-41a8bd90555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.585761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccb795-a2a9-48b8-a58b-41a8bd90555c admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.586237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccb795-a2a9-48b8-a58b-41a8bd90555c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.586718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccb795-a2a9-48b8-a58b-41a8bd90555c admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.588014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccb795-a2a9-48b8-a58b-41a8bd90555c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.590682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccb795-a2a9-48b8-a58b-41a8bd90555c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.662016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 910/1822] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:19.662433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 913/1823] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:19.662433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccb795-a2a9-48b8-a58b-41a8bd90555c admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:19.662591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537fcbb-4054-4ea1-a9cb-c38ade5c0350 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.662591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537fcbb-4054-4ea1-a9cb-c38ade5c0350 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.662591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537fcbb-4054-4ea1-a9cb-c38ade5c0350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.700301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6537fcbb-4054-4ea1-a9cb-c38ade5c0350 None None] MFA Rules not processed for user `bf8f853de116404dbc3af797fb2d45b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:19.701563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6537fcbb-4054-4ea1-a9cb-c38ade5c0350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.740879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccb795-a2a9-48b8-a58b-41a8bd90555c admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.746646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9519f-3191-4be3-b044-026aedfda7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.747291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9519f-3191-4be3-b044-026aedfda7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.747685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9519f-3191-4be3-b044-026aedfda7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.747855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9519f-3191-4be3-b044-026aedfda7a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.748556 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9519f-3191-4be3-b044-026aedfda7a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:19.748855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9519f-3191-4be3-b044-026aedfda7a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.750476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9519f-3191-4be3-b044-026aedfda7a6 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.767039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 914/1824] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:19.768374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9519f-3191-4be3-b044-026aedfda7a6 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:19.779958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9519f-3191-4be3-b044-026aedfda7a6 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.784682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03e00-a967-4865-a72b-58d493326476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.785315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03e00-a967-4865-a72b-58d493326476 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.785605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03e00-a967-4865-a72b-58d493326476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.785877 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03e00-a967-4865-a72b-58d493326476 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.786547 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03e00-a967-4865-a72b-58d493326476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.788575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e03e00-a967-4865-a72b-58d493326476 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.803445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 911/1825] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:19.805060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537fcbb-4054-4ea1-a9cb-c38ade5c0350 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:19.822234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537fcbb-4054-4ea1-a9cb-c38ade5c0350 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.829372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ed5fe-8341-4987-9762-7ab131f1096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.830260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ed5fe-8341-4987-9762-7ab131f1096b admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.830614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ed5fe-8341-4987-9762-7ab131f1096b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.830946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ed5fe-8341-4987-9762-7ab131f1096b admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.831937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ed5fe-8341-4987-9762-7ab131f1096b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.834441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ed5fe-8341-4987-9762-7ab131f1096b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.835279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 915/1826] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:19.836086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03e00-a967-4865-a72b-58d493326476 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:19.857725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 912/1827] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/users => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:19.858756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ed5fe-8341-4987-9762-7ab131f1096b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:19.860844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-aa0ed5fe-8341-4987-9762-7ab131f1096b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:19.891797 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:19.911082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03e00-a967-4865-a72b-58d493326476 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.916087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbac48c-71ca-45f8-a26c-353367b5277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:19.916743 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbac48c-71ca-45f8-a26c-353367b5277e admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:19.917145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbac48c-71ca-45f8-a26c-353367b5277e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:19.917458 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbac48c-71ca-45f8-a26c-353367b5277e admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:19.918255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbac48c-71ca-45f8-a26c-353367b5277e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:19.920151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbac48c-71ca-45f8-a26c-353367b5277e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:19.926248 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ed5fe-8341-4987-9762-7ab131f1096b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:19.945909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:19.957158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 916/1828] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/projects => generated 399 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:19.959169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbac48c-71ca-45f8-a26c-353367b5277e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.000830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dc768-af2a-47e0-afb9-fd9e16971a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.001564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dc768-af2a-47e0-afb9-fd9e16971a1b service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.001990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dc768-af2a-47e0-afb9-fd9e16971a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.002266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dc768-af2a-47e0-afb9-fd9e16971a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.074176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbac48c-71ca-45f8-a26c-353367b5277e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.082823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3b324-a4ad-4f74-9725-40bca4f6fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.084194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3b324-a4ad-4f74-9725-40bca4f6fa2c admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.084476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3b324-a4ad-4f74-9725-40bca4f6fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.084750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3b324-a4ad-4f74-9725-40bca4f6fa2c admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.085458 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3b324-a4ad-4f74-9725-40bca4f6fa2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.087430 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3b324-a4ad-4f74-9725-40bca4f6fa2c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.105881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6dc768-af2a-47e0-afb9-fd9e16971a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.110357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6dc768-af2a-47e0-afb9-fd9e16971a1b service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.123302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 913/1829] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:20.124560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dc768-af2a-47e0-afb9-fd9e16971a1b service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.141886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dc768-af2a-47e0-afb9-fd9e16971a1b service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.144957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 917/1830] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:19 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:20.144957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3b324-a4ad-4f74-9725-40bca4f6fa2c admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.150192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660acdb5-d7ee-490e-9026-a4211e062e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.151188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660acdb5-d7ee-490e-9026-a4211e062e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.151567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660acdb5-d7ee-490e-9026-a4211e062e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.151942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660acdb5-d7ee-490e-9026-a4211e062e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.152769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660acdb5-d7ee-490e-9026-a4211e062e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.155018 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660acdb5-d7ee-490e-9026-a4211e062e74 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.172723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 914/1831] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:20.172723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660acdb5-d7ee-490e-9026-a4211e062e74 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.174972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3b324-a4ad-4f74-9725-40bca4f6fa2c admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.187072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660acdb5-d7ee-490e-9026-a4211e062e74 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.192228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2af634-fe29-4380-b947-e7bbc3fbf398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.192859 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af634-fe29-4380-b947-e7bbc3fbf398 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.193210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af634-fe29-4380-b947-e7bbc3fbf398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.193311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255320-fd71-4e54-9aa7-2e3fad35f2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.193500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af634-fe29-4380-b947-e7bbc3fbf398 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.194066 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255320-fd71-4e54-9aa7-2e3fad35f2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.194299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2af634-fe29-4380-b947-e7bbc3fbf398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.194405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255320-fd71-4e54-9aa7-2e3fad35f2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.194754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255320-fd71-4e54-9aa7-2e3fad35f2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.196034 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255320-fd71-4e54-9aa7-2e3fad35f2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.196227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2af634-fe29-4380-b947-e7bbc3fbf398 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.197586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255320-fd71-4e54-9aa7-2e3fad35f2c1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.213397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 915/1832] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:20.213607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255320-fd71-4e54-9aa7-2e3fad35f2c1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.231695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255320-fd71-4e54-9aa7-2e3fad35f2c1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.236681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d6204-813e-4036-91ba-2f57500265ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.238163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d6204-813e-4036-91ba-2f57500265ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.238679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d6204-813e-4036-91ba-2f57500265ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.239241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d6204-813e-4036-91ba-2f57500265ca admin admin] PATH_INFO: `/v3/projects/4beff622e61c4aca8d7842d4bedb8903/users/bd1641b7aa2f456cbae2de5ea41e1f9e/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.270294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 918/1833] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:20 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:20.272444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2af634-fe29-4380-b947-e7bbc3fbf398 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.277637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d6204-813e-4036-91ba-2f57500265ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4beff622e61c4aca8d7842d4bedb8903, user_id=bd1641b7aa2f456cbae2de5ea41e1f9e, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.281493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d6204-813e-4036-91ba-2f57500265ca admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.295854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2af634-fe29-4380-b947-e7bbc3fbf398 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.306310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 916/1834] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:20 2022] PUT /identity/v3/projects/4beff622e61c4aca8d7842d4bedb8903/users/bd1641b7aa2f456cbae2de5ea41e1f9e/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:20.308205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d6204-813e-4036-91ba-2f57500265ca admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.408460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:20.458400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d6204-813e-4036-91ba-2f57500265ca admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.486373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddc3fb-803f-406c-b499-7625d20a04d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.487235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc3fb-803f-406c-b499-7625d20a04d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.488691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc3fb-803f-406c-b499-7625d20a04d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.489296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc3fb-803f-406c-b499-7625d20a04d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.493114 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddc3fb-803f-406c-b499-7625d20a04d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.495228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddc3fb-803f-406c-b499-7625d20a04d2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.497228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff86c0a-3f5c-49b3-a9b2-736923d787eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.497953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff86c0a-3f5c-49b3-a9b2-736923d787eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.498229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff86c0a-3f5c-49b3-a9b2-736923d787eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.498771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff86c0a-3f5c-49b3-a9b2-736923d787eb admin admin] PATH_INFO: `/v3/projects/efacbe9067a14618af1f9bb9adefd10b/users/d5f349c67a1c471397a03c3deb7d35ff/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.524154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff86c0a-3f5c-49b3-a9b2-736923d787eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=efacbe9067a14618af1f9bb9adefd10b, user_id=d5f349c67a1c471397a03c3deb7d35ff, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.528219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 917/1835] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:20.528366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff86c0a-3f5c-49b3-a9b2-736923d787eb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.528818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddc3fb-803f-406c-b499-7625d20a04d2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.544368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddc3fb-803f-406c-b499-7625d20a04d2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.565421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 919/1836] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:20 2022] PUT /identity/v3/projects/efacbe9067a14618af1f9bb9adefd10b/users/d5f349c67a1c471397a03c3deb7d35ff/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:20.567220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff86c0a-3f5c-49b3-a9b2-736923d787eb admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.652274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736dba0-9587-440a-b0fb-19a2149f0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.653314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736dba0-9587-440a-b0fb-19a2149f0d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.653691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736dba0-9587-440a-b0fb-19a2149f0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.654178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736dba0-9587-440a-b0fb-19a2149f0d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.655603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736dba0-9587-440a-b0fb-19a2149f0d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.656995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736dba0-9587-440a-b0fb-19a2149f0d86 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.681664 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:20.696631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff86c0a-3f5c-49b3-a9b2-736923d787eb admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.696867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 918/1837] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:20.702295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48573db-ec88-4012-a356-d144ae6dca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.703026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48573db-ec88-4012-a356-d144ae6dca6a admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.703318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48573db-ec88-4012-a356-d144ae6dca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.703570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736dba0-9587-440a-b0fb-19a2149f0d86 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.703685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48573db-ec88-4012-a356-d144ae6dca6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.704961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48573db-ec88-4012-a356-d144ae6dca6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.706717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48573db-ec88-4012-a356-d144ae6dca6a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.721583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 920/1838] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:20.722503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48573db-ec88-4012-a356-d144ae6dca6a admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.728481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736dba0-9587-440a-b0fb-19a2149f0d86 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.735768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48573db-ec88-4012-a356-d144ae6dca6a admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.741287 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f1d02-b537-4a52-879c-1a517a2e6b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.741993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f1d02-b537-4a52-879c-1a517a2e6b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.742468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f1d02-b537-4a52-879c-1a517a2e6b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.742707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f1d02-b537-4a52-879c-1a517a2e6b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.743263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6732bc3-75ee-41a2-a2d5-20f1cf9ce931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.743432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f1d02-b537-4a52-879c-1a517a2e6b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.748126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6732bc3-75ee-41a2-a2d5-20f1cf9ce931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.748367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6732bc3-75ee-41a2-a2d5-20f1cf9ce931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.748986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6732bc3-75ee-41a2-a2d5-20f1cf9ce931 admin admin] PATH_INFO: `/v3/projects/4beff622e61c4aca8d7842d4bedb8903/users/bd1641b7aa2f456cbae2de5ea41e1f9e/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.751215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f1d02-b537-4a52-879c-1a517a2e6b0f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.752163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6732bc3-75ee-41a2-a2d5-20f1cf9ce931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4beff622e61c4aca8d7842d4bedb8903, user_id=bd1641b7aa2f456cbae2de5ea41e1f9e, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.755092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6732bc3-75ee-41a2-a2d5-20f1cf9ce931 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.771401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 921/1839] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:20 2022] PUT /identity/v3/projects/4beff622e61c4aca8d7842d4bedb8903/users/bd1641b7aa2f456cbae2de5ea41e1f9e/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:20.773209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6732bc3-75ee-41a2-a2d5-20f1cf9ce931 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.803502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 919/1840] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:20.805315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce515d-63ee-4750-ac34-854c26f45a64 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.805628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce515d-63ee-4750-ac34-854c26f45a64 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.805907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce515d-63ee-4750-ac34-854c26f45a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.852299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-95ce515d-63ee-4750-ac34-854c26f45a64 None None] MFA Rules not processed for user `bd1641b7aa2f456cbae2de5ea41e1f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:20.853627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-95ce515d-63ee-4750-ac34-854c26f45a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:20.877529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6732bc3-75ee-41a2-a2d5-20f1cf9ce931 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.887439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762aef5f-b205-4af9-a805-a8d71c2f95e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:20.889792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aef5f-b205-4af9-a805-a8d71c2f95e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:20.890305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aef5f-b205-4af9-a805-a8d71c2f95e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:20.890759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aef5f-b205-4af9-a805-a8d71c2f95e8 admin admin] PATH_INFO: `/v3/projects/d3104a7b77e84909b20a88859e650a56/users/e9f329efd366401985bf7c24b06cb175/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:20.934331 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762aef5f-b205-4af9-a805-a8d71c2f95e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3104a7b77e84909b20a88859e650a56, user_id=e9f329efd366401985bf7c24b06cb175, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:20.937478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762aef5f-b205-4af9-a805-a8d71c2f95e8 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:20.942579 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 920/1841] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:20.946981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce515d-63ee-4750-ac34-854c26f45a64 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:20.955295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce515d-63ee-4750-ac34-854c26f45a64 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:20.958931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 922/1842] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:20 2022] PUT /identity/v3/projects/d3104a7b77e84909b20a88859e650a56/users/e9f329efd366401985bf7c24b06cb175/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:20.959970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762aef5f-b205-4af9-a805-a8d71c2f95e8 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:21.017264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:21.028781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6e181-11fa-4de1-aa89-a1f047d4c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:21.029433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762aef5f-b205-4af9-a805-a8d71c2f95e8 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:21.029557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e181-11fa-4de1-aa89-a1f047d4c720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.029786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e181-11fa-4de1-aa89-a1f047d4c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.030052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6e181-11fa-4de1-aa89-a1f047d4c720 admin admin] PATH_INFO: `/v3/projects/efacbe9067a14618af1f9bb9adefd10b/users/d5f349c67a1c471397a03c3deb7d35ff/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.032012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6e181-11fa-4de1-aa89-a1f047d4c720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efacbe9067a14618af1f9bb9adefd10b, user_id=d5f349c67a1c471397a03c3deb7d35ff, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:21.033640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988dbd3-f670-451c-b39b-be821f79f1ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:21.034255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988dbd3-f670-451c-b39b-be821f79f1ea service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.034857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988dbd3-f670-451c-b39b-be821f79f1ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.034970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6e181-11fa-4de1-aa89-a1f047d4c720 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:21.035054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988dbd3-f670-451c-b39b-be821f79f1ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.050655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 921/1843] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:20 2022] PUT /identity/v3/projects/efacbe9067a14618af1f9bb9adefd10b/users/d5f349c67a1c471397a03c3deb7d35ff/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:21.052324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15f1b-4028-462c-b67c-41e5c5ab43fc None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.052490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15f1b-4028-462c-b67c-41e5c5ab43fc None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.059980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15f1b-4028-462c-b67c-41e5c5ab43fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.091481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c6e15f1b-4028-462c-b67c-41e5c5ab43fc None None] MFA Rules not processed for user `e9f329efd366401985bf7c24b06cb175`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:21.093016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c6e15f1b-4028-462c-b67c-41e5c5ab43fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:21.109368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988dbd3-f670-451c-b39b-be821f79f1ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:21.110758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988dbd3-f670-451c-b39b-be821f79f1ea service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:21.121183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 923/1844] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:21.122996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf361c3-bce7-4fd6-90a8-ad8613a8d83b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.122996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf361c3-bce7-4fd6-90a8-ad8613a8d83b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.123203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf361c3-bce7-4fd6-90a8-ad8613a8d83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.158719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:21.176563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-cdf361c3-bce7-4fd6-90a8-ad8613a8d83b None None] MFA Rules not processed for user `d5f349c67a1c471397a03c3deb7d35ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:21.177697 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-cdf361c3-bce7-4fd6-90a8-ad8613a8d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:21.225487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 922/1845] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:21 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:21.227563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15f1b-4028-462c-b67c-41e5c5ab43fc None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:21.272077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 924/1846] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:21.281125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf361c3-bce7-4fd6-90a8-ad8613a8d83b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:21.307552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15f1b-4028-462c-b67c-41e5c5ab43fc None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:21.313934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0eff5-93e1-4fba-bcd6-14fb16311cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:21.315435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0eff5-93e1-4fba-bcd6-14fb16311cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.315790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0eff5-93e1-4fba-bcd6-14fb16311cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.316622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0eff5-93e1-4fba-bcd6-14fb16311cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.317565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0eff5-93e1-4fba-bcd6-14fb16311cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:21.321350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0eff5-93e1-4fba-bcd6-14fb16311cc8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:21.374742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf361c3-bce7-4fd6-90a8-ad8613a8d83b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:21.376969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 923/1847] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:21 2022] POST /identity/v3/projects => generated 399 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:21.381139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0eff5-93e1-4fba-bcd6-14fb16311cc8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:21.448742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc391c-c558-4c14-af3b-1a96c385a9a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:21.449595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc391c-c558-4c14-af3b-1a96c385a9a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.449981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc391c-c558-4c14-af3b-1a96c385a9a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.450609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc391c-c558-4c14-af3b-1a96c385a9a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.484090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0eff5-93e1-4fba-bcd6-14fb16311cc8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:21.491710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed8598-2798-4259-a714-c563b20ea5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:21.492368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed8598-2798-4259-a714-c563b20ea5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.492649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed8598-2798-4259-a714-c563b20ea5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.492972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed8598-2798-4259-a714-c563b20ea5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.493676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed8598-2798-4259-a714-c563b20ea5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:21.496949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed8598-2798-4259-a714-c563b20ea5a4 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:21.515439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:21.547618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 924/1848] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:21 2022] POST /identity/v3/users => generated 306 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:21.550943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed8598-2798-4259-a714-c563b20ea5a4 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:21.555068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc391c-c558-4c14-af3b-1a96c385a9a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:21.560318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc391c-c558-4c14-af3b-1a96c385a9a8 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:21.565542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed8598-2798-4259-a714-c563b20ea5a4 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:21.572221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf26a6-ef5b-4801-96e5-3caf82c14914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:21.573549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf26a6-ef5b-4801-96e5-3caf82c14914 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.573832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf26a6-ef5b-4801-96e5-3caf82c14914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.574153 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf26a6-ef5b-4801-96e5-3caf82c14914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.575261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf26a6-ef5b-4801-96e5-3caf82c14914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:21.577877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf26a6-ef5b-4801-96e5-3caf82c14914 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:21.581839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 925/1849] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:21.592621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 925/1850] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:21.596794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc391c-c558-4c14-af3b-1a96c385a9a8 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:21.605995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:21.617639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc391c-c558-4c14-af3b-1a96c385a9a8 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:21.626281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf91b9-908c-4402-8ec1-c1146e5abe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:21.627324 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf91b9-908c-4402-8ec1-c1146e5abe19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.627828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf91b9-908c-4402-8ec1-c1146e5abe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.628321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf91b9-908c-4402-8ec1-c1146e5abe19 admin admin] PATH_INFO: `/v3/projects/35adabb39ea84467b6e69f791e641628/users/cbf472eb79974386ade8f9f329d92326/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.653848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf91b9-908c-4402-8ec1-c1146e5abe19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35adabb39ea84467b6e69f791e641628, user_id=cbf472eb79974386ade8f9f329d92326, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:21.658352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf91b9-908c-4402-8ec1-c1146e5abe19 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:21.686855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 926/1851] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:21 2022] PUT /identity/v3/projects/35adabb39ea84467b6e69f791e641628/users/cbf472eb79974386ade8f9f329d92326/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:21.692096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf26a6-ef5b-4801-96e5-3caf82c14914 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:21.714767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf26a6-ef5b-4801-96e5-3caf82c14914 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:21.827384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c44ba-1b89-4be3-ab7b-c4d61921b888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:21.828352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c44ba-1b89-4be3-ab7b-c4d61921b888 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.828352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c44ba-1b89-4be3-ab7b-c4d61921b888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.828628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c44ba-1b89-4be3-ab7b-c4d61921b888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.829992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c44ba-1b89-4be3-ab7b-c4d61921b888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:21.833721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c44ba-1b89-4be3-ab7b-c4d61921b888 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:21.862215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 926/1852] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:21.863482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf91b9-908c-4402-8ec1-c1146e5abe19 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:21.894494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf91b9-908c-4402-8ec1-c1146e5abe19 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:21.914088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0015-8ad6-4776-8788-f60d6210b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:21.914787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0015-8ad6-4776-8788-f60d6210b221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.915075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0015-8ad6-4776-8788-f60d6210b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.915354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0015-8ad6-4776-8788-f60d6210b221 admin admin] PATH_INFO: `/v3/projects/35adabb39ea84467b6e69f791e641628/users/cbf472eb79974386ade8f9f329d92326/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:21.918525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0015-8ad6-4776-8788-f60d6210b221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35adabb39ea84467b6e69f791e641628, user_id=cbf472eb79974386ade8f9f329d92326, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:21.922519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0015-8ad6-4776-8788-f60d6210b221 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:21.950962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 927/1853] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:21 2022] PUT /identity/v3/projects/35adabb39ea84467b6e69f791e641628/users/cbf472eb79974386ade8f9f329d92326/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:21.963144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52a9d3-5119-472c-a174-c26fe4b70850 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:21.963465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52a9d3-5119-472c-a174-c26fe4b70850 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:21.963952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52a9d3-5119-472c-a174-c26fe4b70850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:22.039874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5c52a9d3-5119-472c-a174-c26fe4b70850 None None] MFA Rules not processed for user `cbf472eb79974386ade8f9f329d92326`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:22.042300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5c52a9d3-5119-472c-a174-c26fe4b70850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:22.192300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 927/1854] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:22.402799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0015-8ad6-4776-8788-f60d6210b221 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:22.540044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0015-8ad6-4776-8788-f60d6210b221 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:22.571631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960f091-179d-4af3-938b-9c616fc447ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:22.572344 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960f091-179d-4af3-938b-9c616fc447ad service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:22.572832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960f091-179d-4af3-938b-9c616fc447ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:22.573007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960f091-179d-4af3-938b-9c616fc447ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:22.605934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960f091-179d-4af3-938b-9c616fc447ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:22.608623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960f091-179d-4af3-938b-9c616fc447ad service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:22.619011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52a9d3-5119-472c-a174-c26fe4b70850 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:22.628438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 928/1855] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:22 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:22.751315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960f091-179d-4af3-938b-9c616fc447ad service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:22.753036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3960f091-179d-4af3-938b-9c616fc447ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:22.754945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52a9d3-5119-472c-a174-c26fe4b70850 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:22.762084 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:22.762968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:22.763490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:22.763874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] PATH_INFO: `/v3/users/6b3d98df487140279f4b982c3b3e47d8` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:22.765770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3d98df487140279f4b982c3b3e47d8)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:22.768640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:22.772124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:22.779917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960f091-179d-4af3-938b-9c616fc447ad service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:22.785269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9185e76-840d-4268-b044-4042613f33a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:22.786231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9185e76-840d-4268-b044-4042613f33a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:22.786695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9185e76-840d-4268-b044-4042613f33a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:22.787162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9185e76-840d-4268-b044-4042613f33a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:22.854040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3d98df487140279f4b982c3b3e47d8'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:22.864216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3d98df487140279f4b982c3b3e47d8'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:22.865201 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9185e76-840d-4268-b044-4042613f33a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:22.873418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9185e76-840d-4268-b044-4042613f33a8 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:22.873859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3d98df487140279f4b982c3b3e47d8'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:22.874660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3d98df487140279f4b982c3b3e47d8'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:22.875344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3d98df487140279f4b982c3b3e47d8'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:22.888525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 929/1856] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:22.930817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6f916-624f-4878-835e-fa7fc1a45f04 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:22.930817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6f916-624f-4878-835e-fa7fc1a45f04 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:22.930817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6f916-624f-4878-835e-fa7fc1a45f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:22.931883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 928/1857] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:22 2022] DELETE /identity/v3/users/6b3d98df487140279f4b982c3b3e47d8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:22.966269 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-55c6f916-624f-4878-835e-fa7fc1a45f04 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:22.967886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-55c6f916-624f-4878-835e-fa7fc1a45f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:23.088115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 930/1858] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:23.126160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:23.128563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:23.282288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6076f3-c486-4930-8306-3c42f6808138 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:23.304344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5253db-19e4-4ace-b332-5df6e84f5e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:23.305815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5253db-19e4-4ace-b332-5df6e84f5e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:23.306102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5253db-19e4-4ace-b332-5df6e84f5e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:23.306376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5253db-19e4-4ace-b332-5df6e84f5e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:23.344781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5253db-19e4-4ace-b332-5df6e84f5e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:23.346655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5253db-19e4-4ace-b332-5df6e84f5e61 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:23.365949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 929/1859] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:23.715871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6f916-624f-4878-835e-fa7fc1a45f04 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:23.724385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-55c6f916-624f-4878-835e-fa7fc1a45f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:23.755423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6f916-624f-4878-835e-fa7fc1a45f04 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:23.764356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:23.765644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:23.766150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:23.766632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] PATH_INFO: `/v3/projects/c056cc76ecc9497d83076159faa96c6a` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:23.768655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c056cc76ecc9497d83076159faa96c6a)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:23.771307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:23.773251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:23.840618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c056cc76ecc9497d83076159faa96c6a', 'request_id': 'req-ff18e195-fbef-4e2f-90e7-fea9b419888d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:23.852142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c056cc76ecc9497d83076159faa96c6a', 'request_id': 'req-ff18e195-fbef-4e2f-90e7-fea9b419888d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:23.865815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c056cc76ecc9497d83076159faa96c6a', 'request_id': 'req-ff18e195-fbef-4e2f-90e7-fea9b419888d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:23.883822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] The token cache is being invalidate because project c056cc76ecc9497d83076159faa96c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:23.884198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:23.885148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ff18e195-fbef-4e2f-90e7-fea9b419888d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:23.887120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 931/1860] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:23 2022] DELETE /identity/v3/projects/c056cc76ecc9497d83076159faa96c6a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:23.890907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5253db-19e4-4ace-b332-5df6e84f5e61 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:23.903000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5253db-19e4-4ace-b332-5df6e84f5e61 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:24.003108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:24.004077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.004531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.004812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] PATH_INFO: `/v3/users/bd1641b7aa2f456cbae2de5ea41e1f9e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.006547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1641b7aa2f456cbae2de5ea41e1f9e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:24.008741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:24.039952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:24.065675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1641b7aa2f456cbae2de5ea41e1f9e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.074471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1641b7aa2f456cbae2de5ea41e1f9e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.082391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1641b7aa2f456cbae2de5ea41e1f9e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.083151 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1641b7aa2f456cbae2de5ea41e1f9e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.083852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8d4c73cd-bfb5-442a-8efd-178a0ab80453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1641b7aa2f456cbae2de5ea41e1f9e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.102565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 930/1861] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:23 2022] DELETE /identity/v3/users/bd1641b7aa2f456cbae2de5ea41e1f9e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:24.569035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76bb14-a428-4bde-bafc-eb9d1a05f9a8 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.569235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76bb14-a428-4bde-bafc-eb9d1a05f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.569557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76bb14-a428-4bde-bafc-eb9d1a05f9a8 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.571406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 932/1862] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:24.597788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bb0da-a322-4226-8fa4-4afc69794080 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.598133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bb0da-a322-4226-8fa4-4afc69794080 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.598356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bb0da-a322-4226-8fa4-4afc69794080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.630082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76bb14-a428-4bde-bafc-eb9d1a05f9a8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:24.638790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ef76bb14-a428-4bde-bafc-eb9d1a05f9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:24.658021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-927bb0da-a322-4226-8fa4-4afc69794080 None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:24.662794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-927bb0da-a322-4226-8fa4-4afc69794080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:24.784223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76bb14-a428-4bde-bafc-eb9d1a05f9a8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:24.793237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:24.794313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.794799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.795663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] PATH_INFO: `/v3/projects/4beff622e61c4aca8d7842d4bedb8903` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.797372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4beff622e61c4aca8d7842d4bedb8903)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:24.801039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:24.839502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 931/1863] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:24.840395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bb0da-a322-4226-8fa4-4afc69794080 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:24.841918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-927bb0da-a322-4226-8fa4-4afc69794080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:24.868799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bb0da-a322-4226-8fa4-4afc69794080 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:24.875370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:24.876112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:24.876394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:24.876701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] PATH_INFO: `/v3/users/2792fb8bfdaa4364913fddfa4702cb57` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:24.878172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2792fb8bfdaa4364913fddfa4702cb57)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:24.880527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:24.893981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4beff622e61c4aca8d7842d4bedb8903', 'request_id': 'req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.905214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4beff622e61c4aca8d7842d4bedb8903', 'request_id': 'req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.913695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4beff622e61c4aca8d7842d4bedb8903', 'request_id': 'req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.937674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] The token cache is being invalidate because project 4beff622e61c4aca8d7842d4bedb8903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:24.938211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.939555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.941810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 933/1864] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:24 2022] DELETE /identity/v3/projects/4beff622e61c4aca8d7842d4bedb8903 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:24.942790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:24.944652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:24.971466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2792fb8bfdaa4364913fddfa4702cb57'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.973398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:24.983095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2792fb8bfdaa4364913fddfa4702cb57'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.994888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2792fb8bfdaa4364913fddfa4702cb57'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.995922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2792fb8bfdaa4364913fddfa4702cb57'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:24.996950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-deb13c5e-9b76-48d7-b047-12ecdf4e54ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2792fb8bfdaa4364913fddfa4702cb57'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:25.032589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 932/1865] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:24 2022] DELETE /identity/v3/users/2792fb8bfdaa4364913fddfa4702cb57 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:25.041362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d1f09-77bc-40bd-b134-7eed07b8444a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.041843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d1f09-77bc-40bd-b134-7eed07b8444a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.042264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d1f09-77bc-40bd-b134-7eed07b8444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.073960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b895f4-7ae3-4c69-b610-2eed07e4fd21 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.079380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:25.095929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-fb6d1f09-77bc-40bd-b134-7eed07b8444a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.098415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fb6d1f09-77bc-40bd-b134-7eed07b8444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.202835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cf8fc-ac1b-4cdb-aaf6-ac5164039c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.203950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf8fc-ac1b-4cdb-aaf6-ac5164039c29 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.204351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf8fc-ac1b-4cdb-aaf6-ac5164039c29 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.205847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf8fc-ac1b-4cdb-aaf6-ac5164039c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.208246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6a9cf8fc-ac1b-4cdb-aaf6-ac5164039c29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.224836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cf8fc-ac1b-4cdb-aaf6-ac5164039c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.226593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cf8fc-ac1b-4cdb-aaf6-ac5164039c29 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.249540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 934/1866] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:25.251768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497960da-ab6e-4c21-8b36-14f4f0150bdf None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.253690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497960da-ab6e-4c21-8b36-14f4f0150bdf None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.255120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497960da-ab6e-4c21-8b36-14f4f0150bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.261553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 933/1867] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.286816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a52b4-76d7-48f6-92a4-1c136f670bc1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.287111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a52b4-76d7-48f6-92a4-1c136f670bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.287469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a52b4-76d7-48f6-92a4-1c136f670bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.309558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-497960da-ab6e-4c21-8b36-14f4f0150bdf None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.311051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-497960da-ab6e-4c21-8b36-14f4f0150bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.319073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1c3a52b4-76d7-48f6-92a4-1c136f670bc1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:25.320508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1c3a52b4-76d7-48f6-92a4-1c136f670bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.327293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 935/1868] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.335118 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497960da-ab6e-4c21-8b36-14f4f0150bdf None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.336914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-497960da-ab6e-4c21-8b36-14f4f0150bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:25.342524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 934/1869] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:25.344744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a52b4-76d7-48f6-92a4-1c136f670bc1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.389127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a52b4-76d7-48f6-92a4-1c136f670bc1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.405590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73584796-f29e-4d04-9fdb-3e1d8c34d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.406288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73584796-f29e-4d04-9fdb-3e1d8c34d865 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.406594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73584796-f29e-4d04-9fdb-3e1d8c34d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.406879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73584796-f29e-4d04-9fdb-3e1d8c34d865 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.407596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73584796-f29e-4d04-9fdb-3e1d8c34d865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:25.407894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73584796-f29e-4d04-9fdb-3e1d8c34d865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.415033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73584796-f29e-4d04-9fdb-3e1d8c34d865 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.444866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 935/1870] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:25.448230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73584796-f29e-4d04-9fdb-3e1d8c34d865 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.480383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73584796-f29e-4d04-9fdb-3e1d8c34d865 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.489826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f934990-8562-4924-8b02-b848898d1e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.490583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f934990-8562-4924-8b02-b848898d1e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.490916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f934990-8562-4924-8b02-b848898d1e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.491158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f934990-8562-4924-8b02-b848898d1e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.491847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f934990-8562-4924-8b02-b848898d1e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.493858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f934990-8562-4924-8b02-b848898d1e85 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.500138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497960da-ab6e-4c21-8b36-14f4f0150bdf None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.506159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edf6e2-6db1-4940-bbcc-60aed74c32e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.509039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edf6e2-6db1-4940-bbcc-60aed74c32e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.510792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edf6e2-6db1-4940-bbcc-60aed74c32e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.511560 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edf6e2-6db1-4940-bbcc-60aed74c32e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.527719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edf6e2-6db1-4940-bbcc-60aed74c32e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.529593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edf6e2-6db1-4940-bbcc-60aed74c32e3 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.534009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 936/1871] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:25.537668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f934990-8562-4924-8b02-b848898d1e85 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.549009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 936/1872] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:25.723070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f934990-8562-4924-8b02-b848898d1e85 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.730601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44c6c2-6daf-4eba-add2-f45167ff21d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.731607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44c6c2-6daf-4eba-add2-f45167ff21d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.731896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44c6c2-6daf-4eba-add2-f45167ff21d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.732235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44c6c2-6daf-4eba-add2-f45167ff21d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.733482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44c6c2-6daf-4eba-add2-f45167ff21d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.736005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44c6c2-6daf-4eba-add2-f45167ff21d8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.778244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 937/1873] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:25.778499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edf6e2-6db1-4940-bbcc-60aed74c32e3 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.792466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edf6e2-6db1-4940-bbcc-60aed74c32e3 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.799065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772423-2657-4e68-965e-54aa63f551ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.799709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772423-2657-4e68-965e-54aa63f551ab admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.800046 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772423-2657-4e68-965e-54aa63f551ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.800328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772423-2657-4e68-965e-54aa63f551ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.801039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94772423-2657-4e68-965e-54aa63f551ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.803733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94772423-2657-4e68-965e-54aa63f551ab admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.817967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 937/1874] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:25.822133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44c6c2-6daf-4eba-add2-f45167ff21d8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.835128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44c6c2-6daf-4eba-add2-f45167ff21d8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.841299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b331b-8e23-4807-8b91-1a115ec686e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.842122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b331b-8e23-4807-8b91-1a115ec686e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.842478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b331b-8e23-4807-8b91-1a115ec686e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.842830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b331b-8e23-4807-8b91-1a115ec686e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.843599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b331b-8e23-4807-8b91-1a115ec686e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.845807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b331b-8e23-4807-8b91-1a115ec686e5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.871867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 938/1875] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:25.872569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772423-2657-4e68-965e-54aa63f551ab admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:25.894115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772423-2657-4e68-965e-54aa63f551ab admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:25.899496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3eff4-0dbd-4b96-81b3-491026c9a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:25.900354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3eff4-0dbd-4b96-81b3-491026c9a831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.900685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3eff4-0dbd-4b96-81b3-491026c9a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.901141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3eff4-0dbd-4b96-81b3-491026c9a831 admin admin] PATH_INFO: `/v3/projects/136641159f694c8fbb21aa9444be3f8d/users/81d82b245978437f97c2dcdf2ca1ff4c/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:25.923356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3eff4-0dbd-4b96-81b3-491026c9a831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136641159f694c8fbb21aa9444be3f8d, user_id=81d82b245978437f97c2dcdf2ca1ff4c, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:25.926961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3eff4-0dbd-4b96-81b3-491026c9a831 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:25.969819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 938/1876] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:25 2022] PUT /identity/v3/projects/136641159f694c8fbb21aa9444be3f8d/users/81d82b245978437f97c2dcdf2ca1ff4c/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:25.972251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78734e-7c75-481f-a7b5-c6079763ff9e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:25.972718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78734e-7c75-481f-a7b5-c6079763ff9e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:25.972839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78734e-7c75-481f-a7b5-c6079763ff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.026451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1f78734e-7c75-481f-a7b5-c6079763ff9e None None] MFA Rules not processed for user `81d82b245978437f97c2dcdf2ca1ff4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:26.027957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1f78734e-7c75-481f-a7b5-c6079763ff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:26.072000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.090051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3eff4-0dbd-4b96-81b3-491026c9a831 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.091868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c1d3eff4-0dbd-4b96-81b3-491026c9a831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:26.099953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.120678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 939/1877] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:26.126005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78734e-7c75-481f-a7b5-c6079763ff9e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.177737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3eff4-0dbd-4b96-81b3-491026c9a831 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.183610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.184431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.184780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.185059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] PATH_INFO: `/v3/projects/c671f87cd9754f33b07a7db7e3673c56` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.186478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c671f87cd9754f33b07a7db7e3673c56)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.189037 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.225564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78734e-7c75-481f-a7b5-c6079763ff9e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.232894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b907-5050-4063-8bbf-c7bdb4a3e954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.233923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b907-5050-4063-8bbf-c7bdb4a3e954 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.234407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b907-5050-4063-8bbf-c7bdb4a3e954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.234924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b907-5050-4063-8bbf-c7bdb4a3e954 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.235810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877b907-5050-4063-8bbf-c7bdb4a3e954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.238256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877b907-5050-4063-8bbf-c7bdb4a3e954 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.255190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c671f87cd9754f33b07a7db7e3673c56', 'request_id': 'req-ac8df011-49fb-46a3-bbcd-e96b013bfb25'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.266113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c671f87cd9754f33b07a7db7e3673c56', 'request_id': 'req-ac8df011-49fb-46a3-bbcd-e96b013bfb25'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.273607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c671f87cd9754f33b07a7db7e3673c56', 'request_id': 'req-ac8df011-49fb-46a3-bbcd-e96b013bfb25'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.279806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 940/1878] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:26.283443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b907-5050-4063-8bbf-c7bdb4a3e954 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.293818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] The token cache is being invalidate because project c671f87cd9754f33b07a7db7e3673c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:26.294168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.294840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.296928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 939/1879] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:26 2022] DELETE /identity/v3/projects/c671f87cd9754f33b07a7db7e3673c56 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:26.301116 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.304216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:26.380090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b907-5050-4063-8bbf-c7bdb4a3e954 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.386605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6492fcd-dc2e-46b9-80fe-e7ffd9130a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.387606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6492fcd-dc2e-46b9-80fe-e7ffd9130a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.387895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6492fcd-dc2e-46b9-80fe-e7ffd9130a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.388168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6492fcd-dc2e-46b9-80fe-e7ffd9130a3a admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.388894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6492fcd-dc2e-46b9-80fe-e7ffd9130a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.391289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6492fcd-dc2e-46b9-80fe-e7ffd9130a3a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.433817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 941/1880] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:26.434022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8df011-49fb-46a3-bbcd-e96b013bfb25 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.434022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.434022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.434022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.434281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] PATH_INFO: `/v3/users/d5f349c67a1c471397a03c3deb7d35ff` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.434281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f349c67a1c471397a03c3deb7d35ff)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.437202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.439327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6492fcd-dc2e-46b9-80fe-e7ffd9130a3a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.446963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f6492fcd-dc2e-46b9-80fe-e7ffd9130a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:26.465960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6492fcd-dc2e-46b9-80fe-e7ffd9130a3a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.472098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e733a7-a89c-4387-b5f5-af3a3a59d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.472972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e733a7-a89c-4387-b5f5-af3a3a59d792 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.473549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e733a7-a89c-4387-b5f5-af3a3a59d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.474093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e733a7-a89c-4387-b5f5-af3a3a59d792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.474728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e733a7-a89c-4387-b5f5-af3a3a59d792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.489964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e733a7-a89c-4387-b5f5-af3a3a59d792 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.491639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.502277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f349c67a1c471397a03c3deb7d35ff'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.511921 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f349c67a1c471397a03c3deb7d35ff'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.523613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f349c67a1c471397a03c3deb7d35ff'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.524441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f349c67a1c471397a03c3deb7d35ff'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.537759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 942/1881] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:26.551522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e733a7-a89c-4387-b5f5-af3a3a59d792 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.551918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f349c67a1c471397a03c3deb7d35ff'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:26.560806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c3e733a7-a89c-4387-b5f5-af3a3a59d792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:26.562938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 940/1882] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:26 2022] DELETE /identity/v3/users/d5f349c67a1c471397a03c3deb7d35ff => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:26.613361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e733a7-a89c-4387-b5f5-af3a3a59d792 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.702663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:26.767001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60dcfb-153a-4afb-a478-08574d4c6210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.769182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60dcfb-153a-4afb-a478-08574d4c6210 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.769607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60dcfb-153a-4afb-a478-08574d4c6210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.770025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60dcfb-153a-4afb-a478-08574d4c6210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.773137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60dcfb-153a-4afb-a478-08574d4c6210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.777823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60dcfb-153a-4afb-a478-08574d4c6210 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.795526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 943/1883] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:26.799891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:26.820824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88da02-f985-40f2-a7cc-65f46bfb1b16 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:26.830149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e816-d8d6-4b5d-823d-98c826d6c9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:26.831843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e816-d8d6-4b5d-823d-98c826d6c9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.832893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e816-d8d6-4b5d-823d-98c826d6c9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.833415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e816-d8d6-4b5d-823d-98c826d6c9ba admin admin] PATH_INFO: `/v3/projects/94d33d6bd5c84888b48f99c71dc43cd7/users/bf24941a0b64439cba9eeacffd8cf412/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.860387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513e816-d8d6-4b5d-823d-98c826d6c9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d33d6bd5c84888b48f99c71dc43cd7, user_id=bf24941a0b64439cba9eeacffd8cf412, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:26.864505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513e816-d8d6-4b5d-823d-98c826d6c9ba admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:26.899030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 941/1884] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:26 2022] PUT /identity/v3/projects/94d33d6bd5c84888b48f99c71dc43cd7/users/bf24941a0b64439cba9eeacffd8cf412/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:26.910833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae585913-b830-44ea-b5ff-5daeb517bd42 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:26.911452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae585913-b830-44ea-b5ff-5daeb517bd42 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:26.911886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae585913-b830-44ea-b5ff-5daeb517bd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:26.966269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ae585913-b830-44ea-b5ff-5daeb517bd42 None None] MFA Rules not processed for user `bf24941a0b64439cba9eeacffd8cf412`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:26.967597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ae585913-b830-44ea-b5ff-5daeb517bd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.007791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e816-d8d6-4b5d-823d-98c826d6c9ba admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.010589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9513e816-d8d6-4b5d-823d-98c826d6c9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.085029 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 944/1885] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:27.092159 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae585913-b830-44ea-b5ff-5daeb517bd42 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.159884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e816-d8d6-4b5d-823d-98c826d6c9ba admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.174488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.175160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.175439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.175714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] PATH_INFO: `/v3/projects/efacbe9067a14618af1f9bb9adefd10b` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.179880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=efacbe9067a14618af1f9bb9adefd10b)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.182910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.239341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae585913-b830-44ea-b5ff-5daeb517bd42 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.247415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671bcae-b3c7-438a-b65e-5a67d6ad4f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.248192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671bcae-b3c7-438a-b65e-5a67d6ad4f2e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.248476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671bcae-b3c7-438a-b65e-5a67d6ad4f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.249166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671bcae-b3c7-438a-b65e-5a67d6ad4f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.250395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671bcae-b3c7-438a-b65e-5a67d6ad4f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.252824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671bcae-b3c7-438a-b65e-5a67d6ad4f2e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.284168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efacbe9067a14618af1f9bb9adefd10b', 'request_id': 'req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:27.299431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efacbe9067a14618af1f9bb9adefd10b', 'request_id': 'req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:27.309530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efacbe9067a14618af1f9bb9adefd10b', 'request_id': 'req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:27.321530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] The token cache is being invalidate because project efacbe9067a14618af1f9bb9adefd10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:27.321811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:27.323119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ed97540b-16eb-4cd3-a44e-c96ff5e9fe6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:27.326296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 942/1886] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:27 2022] DELETE /identity/v3/projects/efacbe9067a14618af1f9bb9adefd10b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:27.331080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c83ead-e92d-47ae-995e-c301a8debe17 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.331644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c83ead-e92d-47ae-995e-c301a8debe17 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.332642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 945/1887] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:27.332915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c83ead-e92d-47ae-995e-c301a8debe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.337185 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671bcae-b3c7-438a-b65e-5a67d6ad4f2e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.340117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6671bcae-b3c7-438a-b65e-5a67d6ad4f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.396906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-44c83ead-e92d-47ae-995e-c301a8debe17 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:27.398178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-44c83ead-e92d-47ae-995e-c301a8debe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.412797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.437906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.473263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671bcae-b3c7-438a-b65e-5a67d6ad4f2e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.481969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced68a64-acfe-4b03-909c-1d3fb52f1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.482621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced68a64-acfe-4b03-909c-1d3fb52f1e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.482901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced68a64-acfe-4b03-909c-1d3fb52f1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.483771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced68a64-acfe-4b03-909c-1d3fb52f1e5e admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.484784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced68a64-acfe-4b03-909c-1d3fb52f1e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.487348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced68a64-acfe-4b03-909c-1d3fb52f1e5e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.519658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 943/1888] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:27.527290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90c009-cb59-404a-9c87-e02ad65694e6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.527863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90c009-cb59-404a-9c87-e02ad65694e6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.528476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90c009-cb59-404a-9c87-e02ad65694e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.531212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 946/1889] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:27.534899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced68a64-acfe-4b03-909c-1d3fb52f1e5e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.550590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced68a64-acfe-4b03-909c-1d3fb52f1e5e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.574326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c451-4904-4062-9206-e6d9cb2286b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.575021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c451-4904-4062-9206-e6d9cb2286b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.576020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c451-4904-4062-9206-e6d9cb2286b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.576020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60c451-4904-4062-9206-e6d9cb2286b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.576439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60c451-4904-4062-9206-e6d9cb2286b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.578108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60c451-4904-4062-9206-e6d9cb2286b1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.580589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9f90c009-cb59-404a-9c87-e02ad65694e6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:27.581834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9f90c009-cb59-404a-9c87-e02ad65694e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.606020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 944/1890] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:27.606573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 947/1891] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:27.607767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90c009-cb59-404a-9c87-e02ad65694e6 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.611422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c451-4904-4062-9206-e6d9cb2286b1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.621912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90c009-cb59-404a-9c87-e02ad65694e6 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.628045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60c451-4904-4062-9206-e6d9cb2286b1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.634007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f84c09-7624-4a57-a4b0-952bfee31782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.634719 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f84c09-7624-4a57-a4b0-952bfee31782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.635006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f84c09-7624-4a57-a4b0-952bfee31782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.635395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f84c09-7624-4a57-a4b0-952bfee31782 admin admin] PATH_INFO: `/v3/projects/a6d0756e08f94849a7b3f5d07e270371/users/0e40d3a398e44787b68c6c982cd5fda3/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.644005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a4899-bff6-4002-82fc-f456f57c7e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.644626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a4899-bff6-4002-82fc-f456f57c7e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.644909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a4899-bff6-4002-82fc-f456f57c7e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.645194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a4899-bff6-4002-82fc-f456f57c7e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.645989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a4899-bff6-4002-82fc-f456f57c7e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:27.646401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a4899-bff6-4002-82fc-f456f57c7e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.648065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a4899-bff6-4002-82fc-f456f57c7e9e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.656527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f84c09-7624-4a57-a4b0-952bfee31782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d0756e08f94849a7b3f5d07e270371, user_id=0e40d3a398e44787b68c6c982cd5fda3, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.659562 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f84c09-7624-4a57-a4b0-952bfee31782 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.671214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 948/1892] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:27.675600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a4899-bff6-4002-82fc-f456f57c7e9e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.681373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 945/1893] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:27 2022] PUT /identity/v3/projects/a6d0756e08f94849a7b3f5d07e270371/users/0e40d3a398e44787b68c6c982cd5fda3/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:27.682928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f84c09-7624-4a57-a4b0-952bfee31782 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.714509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a4899-bff6-4002-82fc-f456f57c7e9e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.811272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f84c09-7624-4a57-a4b0-952bfee31782 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.816655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cef832-a148-4237-9cd6-93fcd7bed33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.817424 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cef832-a148-4237-9cd6-93fcd7bed33c admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.817811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cef832-a148-4237-9cd6-93fcd7bed33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.818089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cef832-a148-4237-9cd6-93fcd7bed33c admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.818238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6445c60-67c2-4309-b124-3bda56965f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.818847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cef832-a148-4237-9cd6-93fcd7bed33c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.819015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445c60-67c2-4309-b124-3bda56965f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.819293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445c60-67c2-4309-b124-3bda56965f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.819695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445c60-67c2-4309-b124-3bda56965f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.820407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6445c60-67c2-4309-b124-3bda56965f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.820921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cef832-a148-4237-9cd6-93fcd7bed33c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.822446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6445c60-67c2-4309-b124-3bda56965f89 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.838809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 946/1894] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:27.842754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6445c60-67c2-4309-b124-3bda56965f89 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.856644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6445c60-67c2-4309-b124-3bda56965f89 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.862134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837f5a9-1831-4d05-80a0-76df513e71dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:27.862871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837f5a9-1831-4d05-80a0-76df513e71dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.863203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837f5a9-1831-4d05-80a0-76df513e71dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.863481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837f5a9-1831-4d05-80a0-76df513e71dd admin admin] PATH_INFO: `/v3/projects/a6d0756e08f94849a7b3f5d07e270371/users/0e40d3a398e44787b68c6c982cd5fda3/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.865751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837f5a9-1831-4d05-80a0-76df513e71dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d0756e08f94849a7b3f5d07e270371, user_id=0e40d3a398e44787b68c6c982cd5fda3, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:27.867075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 949/1895] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:27.870362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837f5a9-1831-4d05-80a0-76df513e71dd admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:27.871365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cef832-a148-4237-9cd6-93fcd7bed33c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:27.880651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 947/1896] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:27 2022] PUT /identity/v3/projects/a6d0756e08f94849a7b3f5d07e270371/users/0e40d3a398e44787b68c6c982cd5fda3/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:27.893382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc354da-b66a-4d92-9cad-a043fbe15e46 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:27.893711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc354da-b66a-4d92-9cad-a043fbe15e46 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:27.893946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc354da-b66a-4d92-9cad-a043fbe15e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:27.930461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9fc354da-b66a-4d92-9cad-a043fbe15e46 None None] MFA Rules not processed for user `0e40d3a398e44787b68c6c982cd5fda3`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:27.931971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9fc354da-b66a-4d92-9cad-a043fbe15e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:27.949007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cef832-a148-4237-9cd6-93fcd7bed33c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:27.995692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:27.998457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:28.008880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 948/1897] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.010775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc354da-b66a-4d92-9cad-a043fbe15e46 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.011827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7cca3-c4c7-4066-b332-46efd852deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.012258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9fc354da-b66a-4d92-9cad-a043fbe15e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.012444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7cca3-c4c7-4066-b332-46efd852deb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.012725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7cca3-c4c7-4066-b332-46efd852deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.013002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7cca3-c4c7-4066-b332-46efd852deb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.013708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7cca3-c4c7-4066-b332-46efd852deb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.015622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7cca3-c4c7-4066-b332-46efd852deb6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.025955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc354da-b66a-4d92-9cad-a043fbe15e46 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.031657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.032391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.032709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.032972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] PATH_INFO: `/v3/users/e9f329efd366401985bf7c24b06cb175` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.034208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f329efd366401985bf7c24b06cb175)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.036279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.038146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 950/1898] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:27 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:28.042490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7cca3-c4c7-4066-b332-46efd852deb6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.044069 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b7c7cca3-c4c7-4066-b332-46efd852deb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.090318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f329efd366401985bf7c24b06cb175'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:28.097778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f329efd366401985bf7c24b06cb175'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:28.104385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7cca3-c4c7-4066-b332-46efd852deb6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.106612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f329efd366401985bf7c24b06cb175'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:28.107292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f329efd366401985bf7c24b06cb175'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:28.108059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8044c21-98ec-42c7-986a-2f63be9636f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.108680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8044c21-98ec-42c7-986a-2f63be9636f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.108957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8044c21-98ec-42c7-986a-2f63be9636f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.109232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8044c21-98ec-42c7-986a-2f63be9636f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.111043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b8044c21-98ec-42c7-986a-2f63be9636f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.120592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f329efd366401985bf7c24b06cb175'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:28.123665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8044c21-98ec-42c7-986a-2f63be9636f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.125112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8044c21-98ec-42c7-986a-2f63be9636f9 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.126733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 949/1899] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:28 2022] DELETE /identity/v3/users/e9f329efd366401985bf7c24b06cb175 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:28.129661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.129661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.136453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 951/1900] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:28.137754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56010047-42be-49f2-b174-9bbf2063ab60 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.138033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56010047-42be-49f2-b174-9bbf2063ab60 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.138296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56010047-42be-49f2-b174-9bbf2063ab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.157979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-56010047-42be-49f2-b174-9bbf2063ab60 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:28.159182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-56010047-42be-49f2-b174-9bbf2063ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.221648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66064c-4171-4552-b22a-032ccf7bfc88 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.226729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6d273-4328-417d-aa8f-e3f80957a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.227357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6d273-4328-417d-aa8f-e3f80957a745 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.227758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6d273-4328-417d-aa8f-e3f80957a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.228390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6d273-4328-417d-aa8f-e3f80957a745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.229266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6d273-4328-417d-aa8f-e3f80957a745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.230933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6d273-4328-417d-aa8f-e3f80957a745 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.246619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 952/1901] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.264601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56010047-42be-49f2-b174-9bbf2063ab60 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.266256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-56010047-42be-49f2-b174-9bbf2063ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.270553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 950/1902] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:28.272473 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6d273-4328-417d-aa8f-e3f80957a745 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.298575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6d273-4328-417d-aa8f-e3f80957a745 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.311231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9056e-592a-413a-b630-19dd16f39cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.312112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9056e-592a-413a-b630-19dd16f39cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.312411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9056e-592a-413a-b630-19dd16f39cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.312687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9056e-592a-413a-b630-19dd16f39cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.313427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9056e-592a-413a-b630-19dd16f39cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.315322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9056e-592a-413a-b630-19dd16f39cb6 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.344908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 951/1903] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:28.349268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9056e-592a-413a-b630-19dd16f39cb6 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.357085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56010047-42be-49f2-b174-9bbf2063ab60 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.361979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a336a8-005a-47af-abf2-2e5210f2e827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.372671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9056e-592a-413a-b630-19dd16f39cb6 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.373594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a336a8-005a-47af-abf2-2e5210f2e827 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.375552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a336a8-005a-47af-abf2-2e5210f2e827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.376000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a336a8-005a-47af-abf2-2e5210f2e827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.382713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9655f4-8818-4bd3-9d75-1beed26b7d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.383385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9655f4-8818-4bd3-9d75-1beed26b7d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.383670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9655f4-8818-4bd3-9d75-1beed26b7d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.384214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9655f4-8818-4bd3-9d75-1beed26b7d06 admin admin] PATH_INFO: `/v3/projects/f4d54cc5f10d4da6b23ef4add8e2e63d/users/1d9920e2d1de4560b0c103dc2b9c8ca4/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.397471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a336a8-005a-47af-abf2-2e5210f2e827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.399156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a336a8-005a-47af-abf2-2e5210f2e827 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.412123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 953/1904] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:28.416762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9655f4-8818-4bd3-9d75-1beed26b7d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d54cc5f10d4da6b23ef4add8e2e63d, user_id=1d9920e2d1de4560b0c103dc2b9c8ca4, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.426997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9655f4-8818-4bd3-9d75-1beed26b7d06 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.460570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 952/1905] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:28 2022] PUT /identity/v3/projects/f4d54cc5f10d4da6b23ef4add8e2e63d/users/1d9920e2d1de4560b0c103dc2b9c8ca4/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:28.474440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645405b-e373-4eed-8cf8-257b9adaadd3 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.475217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645405b-e373-4eed-8cf8-257b9adaadd3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.476345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645405b-e373-4eed-8cf8-257b9adaadd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.528234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1645405b-e373-4eed-8cf8-257b9adaadd3 None None] MFA Rules not processed for user `1d9920e2d1de4560b0c103dc2b9c8ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:28.529709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1645405b-e373-4eed-8cf8-257b9adaadd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:28.542342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:28.652278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 954/1906] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:28.657181 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9655f4-8818-4bd3-9d75-1beed26b7d06 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.743763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:28.850152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9655f4-8818-4bd3-9d75-1beed26b7d06 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:28.866953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1015eaa-ddd3-46a4-9b5a-c6ea1f04a825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:28.867659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1015eaa-ddd3-46a4-9b5a-c6ea1f04a825 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:28.868009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1015eaa-ddd3-46a4-9b5a-c6ea1f04a825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:28.868353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1015eaa-ddd3-46a4-9b5a-c6ea1f04a825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:28.869139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1015eaa-ddd3-46a4-9b5a-c6ea1f04a825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:28.871223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1015eaa-ddd3-46a4-9b5a-c6ea1f04a825 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:28.937722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 953/1907] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/projects => generated 373 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:28.941951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645405b-e373-4eed-8cf8-257b9adaadd3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:28.967371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645405b-e373-4eed-8cf8-257b9adaadd3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.095168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db8e87-5e66-4261-ac85-2567098dfc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.096465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db8e87-5e66-4261-ac85-2567098dfc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.096848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db8e87-5e66-4261-ac85-2567098dfc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.097131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db8e87-5e66-4261-ac85-2567098dfc61 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.097945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db8e87-5e66-4261-ac85-2567098dfc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.100192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db8e87-5e66-4261-ac85-2567098dfc61 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.119761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1015eaa-ddd3-46a4-9b5a-c6ea1f04a825 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.122891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c1015eaa-ddd3-46a4-9b5a-c6ea1f04a825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:29.166475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 955/1908] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:28 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:29.167403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db8e87-5e66-4261-ac85-2567098dfc61 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.170260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-99db8e87-5e66-4261-ac85-2567098dfc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:29.186615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db8e87-5e66-4261-ac85-2567098dfc61 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.197046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.198898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.199700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.200278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] PATH_INFO: `/v3/projects/d3104a7b77e84909b20a88859e650a56` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.202131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3104a7b77e84909b20a88859e650a56)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.207357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.216612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1015eaa-ddd3-46a4-9b5a-c6ea1f04a825 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.226193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c8969-0b49-4100-a6b7-8af8b9d9fb9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.227013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c8969-0b49-4100-a6b7-8af8b9d9fb9b service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.227890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c8969-0b49-4100-a6b7-8af8b9d9fb9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.228700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c8969-0b49-4100-a6b7-8af8b9d9fb9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.232183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-767c8969-0b49-4100-a6b7-8af8b9d9fb9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:29.296653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3104a7b77e84909b20a88859e650a56', 'request_id': 'req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.314783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3104a7b77e84909b20a88859e650a56', 'request_id': 'req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.326298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3104a7b77e84909b20a88859e650a56', 'request_id': 'req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.350675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c8969-0b49-4100-a6b7-8af8b9d9fb9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.352379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c8969-0b49-4100-a6b7-8af8b9d9fb9b service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.360010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] The token cache is being invalidate because project d3104a7b77e84909b20a88859e650a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:29.360304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.363006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.365916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 954/1909] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:29.366143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 956/1910] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:29 2022] DELETE /identity/v3/projects/d3104a7b77e84909b20a88859e650a56 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:29.369617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c8969-0b49-4100-a6b7-8af8b9d9fb9b service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.370509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.372617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:29.385896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c8969-0b49-4100-a6b7-8af8b9d9fb9b service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.428027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:29.515507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362b69e-e0cb-45ae-8f53-2a5d24f590e8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.518948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b808-3034-40f2-a458-ec5af8e2f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.519634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b808-3034-40f2-a458-ec5af8e2f018 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.520126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b808-3034-40f2-a458-ec5af8e2f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.520403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91b808-3034-40f2-a458-ec5af8e2f018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.520637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.521100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91b808-3034-40f2-a458-ec5af8e2f018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.521491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.521930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.522316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] PATH_INFO: `/v3/users/cbf472eb79974386ade8f9f329d92326` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.523013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91b808-3034-40f2-a458-ec5af8e2f018 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.523694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf472eb79974386ade8f9f329d92326)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.526282 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.535243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 955/1911] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:29.540037 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b808-3034-40f2-a458-ec5af8e2f018 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.542335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7b91b808-3034-40f2-a458-ec5af8e2f018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:29.582057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91b808-3034-40f2-a458-ec5af8e2f018 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.589897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf472eb79974386ade8f9f329d92326'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.591304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a89b8-265b-4b2f-993d-d8879b9c7aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.592055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a89b8-265b-4b2f-993d-d8879b9c7aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.592394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a89b8-265b-4b2f-993d-d8879b9c7aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.592682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a89b8-265b-4b2f-993d-d8879b9c7aeb admin admin] PATH_INFO: `/v3/projects/62a3c82d15ee49719dc9dc76daf7968f/users/73cbd30ba8784534805e5e2e1cd00358/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.596345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:29.600949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf472eb79974386ade8f9f329d92326'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.611777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf472eb79974386ade8f9f329d92326'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.612638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf472eb79974386ade8f9f329d92326'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.613418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf472eb79974386ade8f9f329d92326'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:29.623155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a89b8-265b-4b2f-993d-d8879b9c7aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a3c82d15ee49719dc9dc76daf7968f, user_id=73cbd30ba8784534805e5e2e1cd00358, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.626684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a89b8-265b-4b2f-993d-d8879b9c7aeb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.640091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 957/1912] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:29 2022] DELETE /identity/v3/users/cbf472eb79974386ade8f9f329d92326 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:29.653412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 956/1913] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:29 2022] PUT /identity/v3/projects/62a3c82d15ee49719dc9dc76daf7968f/users/73cbd30ba8784534805e5e2e1cd00358/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:29.653592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.654512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:29.654949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a89b8-265b-4b2f-993d-d8879b9c7aeb admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.659196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d84a89b8-265b-4b2f-993d-d8879b9c7aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:29.794588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a89b8-265b-4b2f-993d-d8879b9c7aeb admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.809284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9323191-c50b-4b6c-9e05-ac8b0d17ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.809941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9323191-c50b-4b6c-9e05-ac8b0d17ca2a admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.810220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9323191-c50b-4b6c-9e05-ac8b0d17ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.810659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9323191-c50b-4b6c-9e05-ac8b0d17ca2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.811607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9323191-c50b-4b6c-9e05-ac8b0d17ca2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.813212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9323191-c50b-4b6c-9e05-ac8b0d17ca2a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.819565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f58312-99b8-4f3d-948c-91b77a8d9888 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.829629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 957/1914] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:29.834847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9323191-c50b-4b6c-9e05-ac8b0d17ca2a admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:29.842866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.844261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.844546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.844824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] PATH_INFO: `/v3/users/8f5292aec821483287e5965190ed6b0d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.849742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5292aec821483287e5965190ed6b0d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.858686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.877463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9323191-c50b-4b6c-9e05-ac8b0d17ca2a admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:29.895035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fde47-c35a-4994-b51e-ded88936b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:29.905419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fde47-c35a-4994-b51e-ded88936b690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.905419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fde47-c35a-4994-b51e-ded88936b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.905419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fde47-c35a-4994-b51e-ded88936b690 admin admin] PATH_INFO: `/v3/projects/62a3c82d15ee49719dc9dc76daf7968f/users/73cbd30ba8784534805e5e2e1cd00358/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.905419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fde47-c35a-4994-b51e-ded88936b690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a3c82d15ee49719dc9dc76daf7968f, user_id=73cbd30ba8784534805e5e2e1cd00358, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:29.914241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fde47-c35a-4994-b51e-ded88936b690 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:29.960586 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 958/1915] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:29 2022] PUT /identity/v3/projects/62a3c82d15ee49719dc9dc76daf7968f/users/73cbd30ba8784534805e5e2e1cd00358/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:29.972175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4662-d8a9-451e-8982-cdd1b352791d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:29.972516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4662-d8a9-451e-8982-cdd1b352791d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:29.972798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e4662-d8a9-451e-8982-cdd1b352791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:29.974743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:29.976908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5292aec821483287e5965190ed6b0d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.005944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5292aec821483287e5965190ed6b0d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.017665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5292aec821483287e5965190ed6b0d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.018401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5292aec821483287e5965190ed6b0d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.019031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-64ef529d-d138-4f36-b821-ef2766bbd40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5292aec821483287e5965190ed6b0d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.044579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-367e4662-d8a9-451e-8982-cdd1b352791d None None] MFA Rules not processed for user `73cbd30ba8784534805e5e2e1cd00358`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:30.045944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-367e4662-d8a9-451e-8982-cdd1b352791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.057765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 958/1916] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:29 2022] DELETE /identity/v3/users/8f5292aec821483287e5965190ed6b0d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:30.062446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc1cfd-1f81-4e51-a8b1-178122102dd6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.065227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc1cfd-1f81-4e51-a8b1-178122102dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.065721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc1cfd-1f81-4e51-a8b1-178122102dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.113642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-62cc1cfd-1f81-4e51-a8b1-178122102dd6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:30.117230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-62cc1cfd-1f81-4e51-a8b1-178122102dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.201931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 959/1917] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:30.209633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4662-d8a9-451e-8982-cdd1b352791d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:30.211140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-367e4662-d8a9-451e-8982-cdd1b352791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.268545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 959/1918] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:30.319255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc1cfd-1f81-4e51-a8b1-178122102dd6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:30.320759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-62cc1cfd-1f81-4e51-a8b1-178122102dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.352527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e4662-d8a9-451e-8982-cdd1b352791d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:30.362263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:30.447447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c25d3b-5e0c-4244-bf94-79a518158742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:30.449265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c25d3b-5e0c-4244-bf94-79a518158742 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.449523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c25d3b-5e0c-4244-bf94-79a518158742 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.450268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c25d3b-5e0c-4244-bf94-79a518158742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.452262 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f8c25d3b-5e0c-4244-bf94-79a518158742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.466195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc1cfd-1f81-4e51-a8b1-178122102dd6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:30.486489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc70a81-ec67-4fc0-88b2-48dbdcb5cd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:30.487686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc70a81-ec67-4fc0-88b2-48dbdcb5cd3e service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.488051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc70a81-ec67-4fc0-88b2-48dbdcb5cd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.488414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc70a81-ec67-4fc0-88b2-48dbdcb5cd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.508808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc70a81-ec67-4fc0-88b2-48dbdcb5cd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:30.510432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc70a81-ec67-4fc0-88b2-48dbdcb5cd3e service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:30.521900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 960/1919] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:30.522850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc70a81-ec67-4fc0-88b2-48dbdcb5cd3e service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:30.524322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4fc70a81-ec67-4fc0-88b2-48dbdcb5cd3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.537158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc70a81-ec67-4fc0-88b2-48dbdcb5cd3e service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:30.540320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c25d3b-5e0c-4244-bf94-79a518158742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:30.548331 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c25d3b-5e0c-4244-bf94-79a518158742 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:30.548482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:30.548482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.548482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.548482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] PATH_INFO: `/v3/projects/35adabb39ea84467b6e69f791e641628` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.550489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35adabb39ea84467b6e69f791e641628)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:30.553548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:30.578491 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 960/1920] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:30.626856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35adabb39ea84467b6e69f791e641628', 'request_id': 'req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.636117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35adabb39ea84467b6e69f791e641628', 'request_id': 'req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.641902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:30.646126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35adabb39ea84467b6e69f791e641628', 'request_id': 'req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.664283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] The token cache is being invalidate because project 35adabb39ea84467b6e69f791e641628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:30.665613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.667552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a39c4552-f2b5-405a-b4fb-e35c6fb5b2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:30.669768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 961/1921] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:30 2022] DELETE /identity/v3/projects/35adabb39ea84467b6e69f791e641628 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:30.675545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f18d8b-352f-4a61-9187-039740dc0fd7 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.675913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f18d8b-352f-4a61-9187-039740dc0fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.676294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f18d8b-352f-4a61-9187-039740dc0fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.706327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-d3f18d8b-352f-4a61-9187-039740dc0fd7 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:30.708350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d3f18d8b-352f-4a61-9187-039740dc0fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.793434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 961/1922] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:30.799477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e2f89-0257-44b7-bf18-59648c93ea59 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.799767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e2f89-0257-44b7-bf18-59648c93ea59 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.800052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e2f89-0257-44b7-bf18-59648c93ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.828613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cb9e2f89-0257-44b7-bf18-59648c93ea59 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:30.829867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cb9e2f89-0257-44b7-bf18-59648c93ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.840250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 962/1923] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:30.845427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f18d8b-352f-4a61-9187-039740dc0fd7 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:30.859395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f18d8b-352f-4a61-9187-039740dc0fd7 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:30.865113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:30.865804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.866082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.866355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.867077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:30.867388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:30.868982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:30.886922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 962/1924] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:30.888597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e2f89-0257-44b7-bf18-59648c93ea59 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:30.895563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:30.903279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e2f89-0257-44b7-bf18-59648c93ea59 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:30.906456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:30.911762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee04e7-78f5-43ed-b197-2bf26fd7776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:30.912392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee04e7-78f5-43ed-b197-2bf26fd7776b admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.912685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee04e7-78f5-43ed-b197-2bf26fd7776b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.913417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee04e7-78f5-43ed-b197-2bf26fd7776b admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.914570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee04e7-78f5-43ed-b197-2bf26fd7776b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:30.917864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee04e7-78f5-43ed-b197-2bf26fd7776b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:30.933066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf45f88-3ceb-4c74-90fb-14de4138d710 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:30.940166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:30.940967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:30.941286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:30.941871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] PATH_INFO: `/v3/projects/5bca4982077b47d9bfd1f1b22179113a` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:30.943057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bca4982077b47d9bfd1f1b22179113a)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:30.944983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:30.968811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 963/1925] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:30 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:30.970278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee04e7-78f5-43ed-b197-2bf26fd7776b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.037798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:31.045754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bca4982077b47d9bfd1f1b22179113a', 'request_id': 'req-fef92f7b-528a-4ee1-a655-5f1a6698716d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.059889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bca4982077b47d9bfd1f1b22179113a', 'request_id': 'req-fef92f7b-528a-4ee1-a655-5f1a6698716d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.073994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bca4982077b47d9bfd1f1b22179113a', 'request_id': 'req-fef92f7b-528a-4ee1-a655-5f1a6698716d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.079891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee04e7-78f5-43ed-b197-2bf26fd7776b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.089434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] The token cache is being invalidate because project 5bca4982077b47d9bfd1f1b22179113a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:31.089900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.090574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.092842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 963/1926] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:30 2022] DELETE /identity/v3/projects/5bca4982077b47d9bfd1f1b22179113a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:31.096660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.099587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.160418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885fed9-a3e7-427e-9997-19082f8e3b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.161309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fed9-a3e7-427e-9997-19082f8e3b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.161682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fed9-a3e7-427e-9997-19082f8e3b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.162022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fed9-a3e7-427e-9997-19082f8e3b55 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.162809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885fed9-a3e7-427e-9997-19082f8e3b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.166819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885fed9-a3e7-427e-9997-19082f8e3b55 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.187723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef92f7b-528a-4ee1-a655-5f1a6698716d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.191936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 964/1927] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:30 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:31.194293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.195134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.195532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.195819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] PATH_INFO: `/v3/users/69101ba515d54009a44b0d5e7171c006` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.197648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69101ba515d54009a44b0d5e7171c006)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.197971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885fed9-a3e7-427e-9997-19082f8e3b55 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.199571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.200122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7885fed9-a3e7-427e-9997-19082f8e3b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.218914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885fed9-a3e7-427e-9997-19082f8e3b55 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.223855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f48343-9f17-4658-a5fe-1fe423704fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.224213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f48343-9f17-4658-a5fe-1fe423704fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.224483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f48343-9f17-4658-a5fe-1fe423704fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.224758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f48343-9f17-4658-a5fe-1fe423704fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.225527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f48343-9f17-4658-a5fe-1fe423704fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.227060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f48343-9f17-4658-a5fe-1fe423704fa7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.239207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 965/1928] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:31.247186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f48343-9f17-4658-a5fe-1fe423704fa7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.257280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f48343-9f17-4658-a5fe-1fe423704fa7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.260483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69101ba515d54009a44b0d5e7171c006'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.264012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16c678-8e2e-4fd9-b2c8-b1bb77411ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.264852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16c678-8e2e-4fd9-b2c8-b1bb77411ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.265215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16c678-8e2e-4fd9-b2c8-b1bb77411ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.265536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16c678-8e2e-4fd9-b2c8-b1bb77411ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.266376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16c678-8e2e-4fd9-b2c8-b1bb77411ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.267950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69101ba515d54009a44b0d5e7171c006'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.268293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16c678-8e2e-4fd9-b2c8-b1bb77411ac6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.275093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69101ba515d54009a44b0d5e7171c006'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.276298 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69101ba515d54009a44b0d5e7171c006'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.280060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 966/1929] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:31.284759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16c678-8e2e-4fd9-b2c8-b1bb77411ac6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.286439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6d16c678-8e2e-4fd9-b2c8-b1bb77411ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.289195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a73408a-fecc-4627-a87a-38452af1ec80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69101ba515d54009a44b0d5e7171c006'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.296191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 964/1930] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:31 2022] DELETE /identity/v3/users/69101ba515d54009a44b0d5e7171c006 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:31.299451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16c678-8e2e-4fd9-b2c8-b1bb77411ac6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.332969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:31.372188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003828e-a405-4d7d-bba0-bb755f2351d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.373194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003828e-a405-4d7d-bba0-bb755f2351d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.373527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003828e-a405-4d7d-bba0-bb755f2351d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.373805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003828e-a405-4d7d-bba0-bb755f2351d5 admin admin] PATH_INFO: `/v3/projects/f804159fee774bdc8d4dc3611357672b/users/4d47ffe54cd946b4bdf7b35f2e1fd1fa/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.393156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003828e-a405-4d7d-bba0-bb755f2351d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f804159fee774bdc8d4dc3611357672b, user_id=4d47ffe54cd946b4bdf7b35f2e1fd1fa, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.395940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003828e-a405-4d7d-bba0-bb755f2351d5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.425896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 967/1931] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:31 2022] PUT /identity/v3/projects/f804159fee774bdc8d4dc3611357672b/users/4d47ffe54cd946b4bdf7b35f2e1fd1fa/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:31.429736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d119b3-102c-479e-bd5b-d45ffe9650c5 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.430231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d119b3-102c-479e-bd5b-d45ffe9650c5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.430514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d119b3-102c-479e-bd5b-d45ffe9650c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.481594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-63d119b3-102c-479e-bd5b-d45ffe9650c5 None None] MFA Rules not processed for user `4d47ffe54cd946b4bdf7b35f2e1fd1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:31.483464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-63d119b3-102c-479e-bd5b-d45ffe9650c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.549425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:31.578195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 965/1932] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:31.582759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003828e-a405-4d7d-bba0-bb755f2351d5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.643320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d119b3-102c-479e-bd5b-d45ffe9650c5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.647258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-63d119b3-102c-479e-bd5b-d45ffe9650c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.698850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003828e-a405-4d7d-bba0-bb755f2351d5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.702877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b6225-9415-45b2-bec4-0260ccbf4297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.703508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b6225-9415-45b2-bec4-0260ccbf4297 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.703787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b6225-9415-45b2-bec4-0260ccbf4297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.704093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b6225-9415-45b2-bec4-0260ccbf4297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.705021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b6225-9415-45b2-bec4-0260ccbf4297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.707686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b6225-9415-45b2-bec4-0260ccbf4297 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.730093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d119b3-102c-479e-bd5b-d45ffe9650c5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.736391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.737040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.737321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.737622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] PATH_INFO: `/v3/projects/58c890a987eb47539aa30d161993db11` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.738785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c890a987eb47539aa30d161993db11)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.740702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.745535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 968/1933] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:31 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:31.746426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b6225-9415-45b2-bec4-0260ccbf4297 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.803872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c890a987eb47539aa30d161993db11', 'request_id': 'req-eb2b4076-c636-492a-873c-865754c57845'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.812193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c890a987eb47539aa30d161993db11', 'request_id': 'req-eb2b4076-c636-492a-873c-865754c57845'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.817451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b6225-9415-45b2-bec4-0260ccbf4297 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.818216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c890a987eb47539aa30d161993db11', 'request_id': 'req-eb2b4076-c636-492a-873c-865754c57845'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.829186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] The token cache is being invalidate because project 58c890a987eb47539aa30d161993db11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:31.829583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.830228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-eb2b4076-c636-492a-873c-865754c57845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:31.831991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 966/1934] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:31 2022] DELETE /identity/v3/projects/58c890a987eb47539aa30d161993db11 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:31.836617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aeda5-6df4-413a-8213-e52004c43a17 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.837066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aeda5-6df4-413a-8213-e52004c43a17 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.837525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aeda5-6df4-413a-8213-e52004c43a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.857791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-913aeda5-6df4-413a-8213-e52004c43a17 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:31.859029 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-913aeda5-6df4-413a-8213-e52004c43a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.865629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:31.877286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b876ef7-eb7f-41f8-9158-00fbffecc6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.877965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b876ef7-eb7f-41f8-9158-00fbffecc6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.878251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b876ef7-eb7f-41f8-9158-00fbffecc6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.878533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b876ef7-eb7f-41f8-9158-00fbffecc6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.879191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b876ef7-eb7f-41f8-9158-00fbffecc6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.881166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b876ef7-eb7f-41f8-9158-00fbffecc6c8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.901665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 969/1935] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:31 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:31.905241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b876ef7-eb7f-41f8-9158-00fbffecc6c8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.906920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8b876ef7-eb7f-41f8-9158-00fbffecc6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.919568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b876ef7-eb7f-41f8-9158-00fbffecc6c8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.920810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 967/1936] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:31.928636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebf11-8cf9-45c9-930d-b2f0f1149926 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.928929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebf11-8cf9-45c9-930d-b2f0f1149926 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.929351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebf11-8cf9-45c9-930d-b2f0f1149926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.930405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159058be-09a6-488e-be76-08e013c830d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.931008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159058be-09a6-488e-be76-08e013c830d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.931288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159058be-09a6-488e-be76-08e013c830d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.932109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159058be-09a6-488e-be76-08e013c830d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.932802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159058be-09a6-488e-be76-08e013c830d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.934478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159058be-09a6-488e-be76-08e013c830d9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.949401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 970/1937] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:31.951440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159058be-09a6-488e-be76-08e013c830d9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.952138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-a81ebf11-8cf9-45c9-930d-b2f0f1149926 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:31.953346 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a81ebf11-8cf9-45c9-930d-b2f0f1149926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:31.961755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159058be-09a6-488e-be76-08e013c830d9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.961911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 968/1938] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:31.966253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebf11-8cf9-45c9-930d-b2f0f1149926 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.967072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee1e8f-c1b5-4879-84da-591564be23b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.967868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee1e8f-c1b5-4879-84da-591564be23b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.968174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee1e8f-c1b5-4879-84da-591564be23b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.968441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee1e8f-c1b5-4879-84da-591564be23b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.969120 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee1e8f-c1b5-4879-84da-591564be23b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.970770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee1e8f-c1b5-4879-84da-591564be23b0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.972170 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:31.976354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebf11-8cf9-45c9-930d-b2f0f1149926 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:31.983252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 971/1939] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:31.983577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20303823-2a0d-47ae-bc9f-d7757b39027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:31.984443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20303823-2a0d-47ae-bc9f-d7757b39027d admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:31.984726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20303823-2a0d-47ae-bc9f-d7757b39027d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:31.985002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20303823-2a0d-47ae-bc9f-d7757b39027d admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:31.985734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20303823-2a0d-47ae-bc9f-d7757b39027d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:31.986040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20303823-2a0d-47ae-bc9f-d7757b39027d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:31.987272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee1e8f-c1b5-4879-84da-591564be23b0 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:31.987788 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20303823-2a0d-47ae-bc9f-d7757b39027d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:31.999442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee1e8f-c1b5-4879-84da-591564be23b0 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.002094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 969/1940] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:36:32.006217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20303823-2a0d-47ae-bc9f-d7757b39027d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.016402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98eff9-fc4b-46f8-bdfb-eb211ff1116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.017109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98eff9-fc4b-46f8-bdfb-eb211ff1116c admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.021231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98eff9-fc4b-46f8-bdfb-eb211ff1116c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.021626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98eff9-fc4b-46f8-bdfb-eb211ff1116c admin admin] PATH_INFO: `/v3/projects/58ff256310ad4af2b8388b5a64082eee/users/9d3bc5b0ccc6415a89e7b62783a1f307/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.022082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20303823-2a0d-47ae-bc9f-d7757b39027d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.029923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eab6da-0a93-409a-95dd-8643d16cf089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.030645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eab6da-0a93-409a-95dd-8643d16cf089 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.030873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eab6da-0a93-409a-95dd-8643d16cf089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.031150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eab6da-0a93-409a-95dd-8643d16cf089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.031976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eab6da-0a93-409a-95dd-8643d16cf089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.034299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eab6da-0a93-409a-95dd-8643d16cf089 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.057920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98eff9-fc4b-46f8-bdfb-eb211ff1116c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ff256310ad4af2b8388b5a64082eee, user_id=9d3bc5b0ccc6415a89e7b62783a1f307, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.063306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98eff9-fc4b-46f8-bdfb-eb211ff1116c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.079715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 972/1941] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:31 2022] PUT /identity/v3/projects/58ff256310ad4af2b8388b5a64082eee/users/9d3bc5b0ccc6415a89e7b62783a1f307/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:32.083427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 970/1942] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:32.087784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98eff9-fc4b-46f8-bdfb-eb211ff1116c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.089933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cb7a-3b66-47dd-9335-45ebb94e1435 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.090488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cb7a-3b66-47dd-9335-45ebb94e1435 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.091021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cb7a-3b66-47dd-9335-45ebb94e1435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.125088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-6ac5cb7a-3b66-47dd-9335-45ebb94e1435 None None] MFA Rules not processed for user `9d3bc5b0ccc6415a89e7b62783a1f307`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:32.126342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6ac5cb7a-3b66-47dd-9335-45ebb94e1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:32.165639 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98eff9-fc4b-46f8-bdfb-eb211ff1116c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.209371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 971/1943] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:32.211284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5cb7a-3b66-47dd-9335-45ebb94e1435 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.251865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5eeab-3840-4275-bbc0-5b09cf4ba228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.254860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5eeab-3840-4275-bbc0-5b09cf4ba228 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.255241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5eeab-3840-4275-bbc0-5b09cf4ba228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.255482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5eeab-3840-4275-bbc0-5b09cf4ba228 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.256293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5eeab-3840-4275-bbc0-5b09cf4ba228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.259250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5eeab-3840-4275-bbc0-5b09cf4ba228 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.304227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 973/1944] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:32.305192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5eeab-3840-4275-bbc0-5b09cf4ba228 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.326006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5eeab-3840-4275-bbc0-5b09cf4ba228 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.339025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d1ce8-44ce-408d-a2e7-d2715a1f64e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.339950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d1ce8-44ce-408d-a2e7-d2715a1f64e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.341563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d1ce8-44ce-408d-a2e7-d2715a1f64e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.342635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d1ce8-44ce-408d-a2e7-d2715a1f64e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.345784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d1ce8-44ce-408d-a2e7-d2715a1f64e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.350946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d1ce8-44ce-408d-a2e7-d2715a1f64e3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.355250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5cb7a-3b66-47dd-9335-45ebb94e1435 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.374068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b1db3-1e5a-41c9-8ebc-6a1e5d62e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.374779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1db3-1e5a-41c9-8ebc-6a1e5d62e080 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.375064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1db3-1e5a-41c9-8ebc-6a1e5d62e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.375625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 974/1945] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:32.377462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1db3-1e5a-41c9-8ebc-6a1e5d62e080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.378515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b1db3-1e5a-41c9-8ebc-6a1e5d62e080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.379335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d1ce8-44ce-408d-a2e7-d2715a1f64e3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.381434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b1db3-1e5a-41c9-8ebc-6a1e5d62e080 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.392716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d1ce8-44ce-408d-a2e7-d2715a1f64e3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.400687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f353-2226-4d7e-bd4a-a997219a036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.402402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f353-2226-4d7e-bd4a-a997219a036f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.402693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f353-2226-4d7e-bd4a-a997219a036f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.402976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f353-2226-4d7e-bd4a-a997219a036f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.404139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330f353-2226-4d7e-bd4a-a997219a036f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.405984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330f353-2226-4d7e-bd4a-a997219a036f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.425500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 975/1946] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:32.425989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 972/1947] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:32.428454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f353-2226-4d7e-bd4a-a997219a036f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.430011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b1db3-1e5a-41c9-8ebc-6a1e5d62e080 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.452062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f353-2226-4d7e-bd4a-a997219a036f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.458997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:32.492049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:32.513584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b1db3-1e5a-41c9-8ebc-6a1e5d62e080 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.518930 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8c2d-cef4-4f7f-bf28-46caba68e67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.519654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8c2d-cef4-4f7f-bf28-46caba68e67e admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.519918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8c2d-cef4-4f7f-bf28-46caba68e67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.520424 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8c2d-cef4-4f7f-bf28-46caba68e67e admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.521085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8c2d-cef4-4f7f-bf28-46caba68e67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.523077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8c2d-cef4-4f7f-bf28-46caba68e67e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.540858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f0e9-fac2-479e-9e56-ea5b37614775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.541863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f0e9-fac2-479e-9e56-ea5b37614775 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.542150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f0e9-fac2-479e-9e56-ea5b37614775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.542429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591f0e9-fac2-479e-9e56-ea5b37614775 admin admin] PATH_INFO: `/v3/projects/3ce527ea06b342a9b0f7ab4a54f8f0c6/users/3fd3c8e7a6d74a389ddc8e56ff555858/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.545831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 973/1948] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:32.549629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8c2d-cef4-4f7f-bf28-46caba68e67e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.560007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591f0e9-fac2-479e-9e56-ea5b37614775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce527ea06b342a9b0f7ab4a54f8f0c6, user_id=3fd3c8e7a6d74a389ddc8e56ff555858, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.561371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8c2d-cef4-4f7f-bf28-46caba68e67e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.563010 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591f0e9-fac2-479e-9e56-ea5b37614775 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.566452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44823f3b-6be7-4866-a97f-c80ee270be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.567100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44823f3b-6be7-4866-a97f-c80ee270be27 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.567384 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44823f3b-6be7-4866-a97f-c80ee270be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.567663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44823f3b-6be7-4866-a97f-c80ee270be27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.568932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44823f3b-6be7-4866-a97f-c80ee270be27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.580585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44823f3b-6be7-4866-a97f-c80ee270be27 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.584493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 976/1949] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:32 2022] PUT /identity/v3/projects/3ce527ea06b342a9b0f7ab4a54f8f0c6/users/3fd3c8e7a6d74a389ddc8e56ff555858/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:32.593015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 974/1950] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:32.598293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f0e9-fac2-479e-9e56-ea5b37614775 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.599971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9ae0-9873-490b-97cc-bd14e7a99c38 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.600440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9ae0-9873-490b-97cc-bd14e7a99c38 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.600725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9ae0-9873-490b-97cc-bd14e7a99c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.634539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e6ac9ae0-9873-490b-97cc-bd14e7a99c38 None None] MFA Rules not processed for user `3fd3c8e7a6d74a389ddc8e56ff555858`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:32.635896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e6ac9ae0-9873-490b-97cc-bd14e7a99c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:32.731892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591f0e9-fac2-479e-9e56-ea5b37614775 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.747311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a27e7-55b2-46f5-8f45-b89e03274824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.748193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a27e7-55b2-46f5-8f45-b89e03274824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.748564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a27e7-55b2-46f5-8f45-b89e03274824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.748857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a27e7-55b2-46f5-8f45-b89e03274824 admin admin] PATH_INFO: `/v3/projects/fb34f27366504c5fae507bee28e13819/users/95b02f7013744f168a18c5e68025148e/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.783631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a27e7-55b2-46f5-8f45-b89e03274824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb34f27366504c5fae507bee28e13819, user_id=95b02f7013744f168a18c5e68025148e, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.790301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 975/1951] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:32.792244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a27e7-55b2-46f5-8f45-b89e03274824 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.795452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9ae0-9873-490b-97cc-bd14e7a99c38 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.812565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9ae0-9873-490b-97cc-bd14e7a99c38 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.821217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 977/1952] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:32 2022] PUT /identity/v3/projects/fb34f27366504c5fae507bee28e13819/users/95b02f7013744f168a18c5e68025148e/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:32.826330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a27e7-55b2-46f5-8f45-b89e03274824 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.914467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc95e0-bf1c-480c-ab07-37f80686ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.915157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc95e0-bf1c-480c-ab07-37f80686ad73 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.915447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc95e0-bf1c-480c-ab07-37f80686ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.916287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc95e0-bf1c-480c-ab07-37f80686ad73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.916397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a27e7-55b2-46f5-8f45-b89e03274824 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.916973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc95e0-bf1c-480c-ab07-37f80686ad73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.919190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc95e0-bf1c-480c-ab07-37f80686ad73 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.921612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca681b08-7995-4f55-aafb-6995c4783193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:32.922229 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca681b08-7995-4f55-aafb-6995c4783193 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:32.922504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca681b08-7995-4f55-aafb-6995c4783193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:32.922777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca681b08-7995-4f55-aafb-6995c4783193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:32.923469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca681b08-7995-4f55-aafb-6995c4783193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:32.925120 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca681b08-7995-4f55-aafb-6995c4783193 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:32.941633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 978/1953] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:32.943658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca681b08-7995-4f55-aafb-6995c4783193 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.955703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca681b08-7995-4f55-aafb-6995c4783193 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:32.957656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 976/1954] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:32.961286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc95e0-bf1c-480c-ab07-37f80686ad73 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:32.965047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:33.018280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:33.043827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc95e0-bf1c-480c-ab07-37f80686ad73 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.046965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fdc3c-0a68-48e9-916f-8a36d89e1f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.048936 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14c086-1579-414a-b67c-f2049b5085d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.049664 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14c086-1579-414a-b67c-f2049b5085d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.050010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14c086-1579-414a-b67c-f2049b5085d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.050365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14c086-1579-414a-b67c-f2049b5085d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.051101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14c086-1579-414a-b67c-f2049b5085d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.053082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14c086-1579-414a-b67c-f2049b5085d2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.065255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fdc3c-0a68-48e9-916f-8a36d89e1f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.065786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fdc3c-0a68-48e9-916f-8a36d89e1f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.066112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fdc3c-0a68-48e9-916f-8a36d89e1f97 admin admin] PATH_INFO: `/v3/projects/fb34f27366504c5fae507bee28e13819/users/95b02f7013744f168a18c5e68025148e/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.068795 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fdc3c-0a68-48e9-916f-8a36d89e1f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb34f27366504c5fae507bee28e13819, user_id=95b02f7013744f168a18c5e68025148e, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.072290 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fdc3c-0a68-48e9-916f-8a36d89e1f97 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.086005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 979/1955] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:32 2022] PUT /identity/v3/projects/fb34f27366504c5fae507bee28e13819/users/95b02f7013744f168a18c5e68025148e/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:33.091217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 977/1956] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:32 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:33.097403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fdc3c-0a68-48e9-916f-8a36d89e1f97 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.098736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73942e-b0fa-436c-a396-7beaea595f39 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.099218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73942e-b0fa-436c-a396-7beaea595f39 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.099652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73942e-b0fa-436c-a396-7beaea595f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.144165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9e73942e-b0fa-436c-a396-7beaea595f39 None None] MFA Rules not processed for user `95b02f7013744f168a18c5e68025148e`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:33.146438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9e73942e-b0fa-436c-a396-7beaea595f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:33.189144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fdc3c-0a68-48e9-916f-8a36d89e1f97 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.213362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7161e7-e78d-4cd4-91cf-73975c2673db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.214059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7161e7-e78d-4cd4-91cf-73975c2673db admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.214339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7161e7-e78d-4cd4-91cf-73975c2673db admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.214617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7161e7-e78d-4cd4-91cf-73975c2673db admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.215325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7161e7-e78d-4cd4-91cf-73975c2673db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.217011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7161e7-e78d-4cd4-91cf-73975c2673db admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.230568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 980/1957] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:33.235623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7161e7-e78d-4cd4-91cf-73975c2673db admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.251429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7161e7-e78d-4cd4-91cf-73975c2673db admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.259959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bcb97-007a-42e7-b982-dbbb42727645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.260708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bcb97-007a-42e7-b982-dbbb42727645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.260992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bcb97-007a-42e7-b982-dbbb42727645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.261523 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bcb97-007a-42e7-b982-dbbb42727645 admin admin] PATH_INFO: `/v3/projects/f8148f61a5b445049bf78544c6b22501/users/ff2a1b045cb84e1095cb06c8b0d78ebf/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.268747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 978/1958] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:33.279329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73942e-b0fa-436c-a396-7beaea595f39 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.281311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9e73942e-b0fa-436c-a396-7beaea595f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:33.282065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bcb97-007a-42e7-b982-dbbb42727645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8148f61a5b445049bf78544c6b22501, user_id=ff2a1b045cb84e1095cb06c8b0d78ebf, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.284982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bcb97-007a-42e7-b982-dbbb42727645 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.302087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 981/1959] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:33 2022] PUT /identity/v3/projects/f8148f61a5b445049bf78544c6b22501/users/ff2a1b045cb84e1095cb06c8b0d78ebf/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:33.307183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bcb97-007a-42e7-b982-dbbb42727645 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.363955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73942e-b0fa-436c-a396-7beaea595f39 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.397607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bcb97-007a-42e7-b982-dbbb42727645 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.403141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87833407-817b-45f0-9ddd-6624562c5b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.403690 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87833407-817b-45f0-9ddd-6624562c5b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.404004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87833407-817b-45f0-9ddd-6624562c5b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.404279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87833407-817b-45f0-9ddd-6624562c5b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.404968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87833407-817b-45f0-9ddd-6624562c5b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.406727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87833407-817b-45f0-9ddd-6624562c5b2e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.433712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17a74a-2e7e-4856-b5ba-4f3aee696d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.434559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17a74a-2e7e-4856-b5ba-4f3aee696d66 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.434913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17a74a-2e7e-4856-b5ba-4f3aee696d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.435257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17a74a-2e7e-4856-b5ba-4f3aee696d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.436291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 982/1960] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:33.442075 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87833407-817b-45f0-9ddd-6624562c5b2e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.463599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87833407-817b-45f0-9ddd-6624562c5b2e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.474293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:33.476852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b1df4-f425-48ab-b394-72fd9d959cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.477573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b1df4-f425-48ab-b394-72fd9d959cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.477920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b1df4-f425-48ab-b394-72fd9d959cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.478123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b1df4-f425-48ab-b394-72fd9d959cb8 admin admin] PATH_INFO: `/v3/projects/f8148f61a5b445049bf78544c6b22501/users/ff2a1b045cb84e1095cb06c8b0d78ebf/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.481440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b1df4-f425-48ab-b394-72fd9d959cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8148f61a5b445049bf78544c6b22501, user_id=ff2a1b045cb84e1095cb06c8b0d78ebf, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.486288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b1df4-f425-48ab-b394-72fd9d959cb8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.498484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:33.513713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 983/1961] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:33 2022] PUT /identity/v3/projects/f8148f61a5b445049bf78544c6b22501/users/ff2a1b045cb84e1095cb06c8b0d78ebf/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:33.514712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b1df4-f425-48ab-b394-72fd9d959cb8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.525666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ff1b1df4-f425-48ab-b394-72fd9d959cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:33.551917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17a74a-2e7e-4856-b5ba-4f3aee696d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.553397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17a74a-2e7e-4856-b5ba-4f3aee696d66 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.566581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 979/1962] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:33.569786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02d14b-21bc-4da5-baae-6774535834b9 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.570184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02d14b-21bc-4da5-baae-6774535834b9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.570589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02d14b-21bc-4da5-baae-6774535834b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.600231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b1df4-f425-48ab-b394-72fd9d959cb8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.606067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74111f3-e22b-4352-846a-a55be184b640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.606705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74111f3-e22b-4352-846a-a55be184b640 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.606982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74111f3-e22b-4352-846a-a55be184b640 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.607256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74111f3-e22b-4352-846a-a55be184b640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.610603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e74111f3-e22b-4352-846a-a55be184b640 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:33.613848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4d02d14b-21bc-4da5-baae-6774535834b9 None None] MFA Rules not processed for user `ff2a1b045cb84e1095cb06c8b0d78ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:33.615714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4d02d14b-21bc-4da5-baae-6774535834b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:33.733970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74111f3-e22b-4352-846a-a55be184b640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.735483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74111f3-e22b-4352-846a-a55be184b640 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.736614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 980/1963] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:33.738150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02d14b-21bc-4da5-baae-6774535834b9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.747956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 984/1964] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:33.750808 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02d14b-21bc-4da5-baae-6774535834b9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.755354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115ba33-972a-4dc0-9d8d-15579f5f4cb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.756082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115ba33-972a-4dc0-9d8d-15579f5f4cb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.756368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115ba33-972a-4dc0-9d8d-15579f5f4cb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.757032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115ba33-972a-4dc0-9d8d-15579f5f4cb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.759191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3115ba33-972a-4dc0-9d8d-15579f5f4cb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:33.848428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115ba33-972a-4dc0-9d8d-15579f5f4cb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.849912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115ba33-972a-4dc0-9d8d-15579f5f4cb3 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.860295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 981/1965] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:33.896129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74111f3-e22b-4352-846a-a55be184b640 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:33.905296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74111f3-e22b-4352-846a-a55be184b640 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:33.909172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802162fe-47e3-4ba7-927f-918e8a9c6e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:33.910077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802162fe-47e3-4ba7-927f-918e8a9c6e64 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:33.910462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802162fe-47e3-4ba7-927f-918e8a9c6e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:33.910832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802162fe-47e3-4ba7-927f-918e8a9c6e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:33.921955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802162fe-47e3-4ba7-927f-918e8a9c6e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:33.923603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802162fe-47e3-4ba7-927f-918e8a9c6e64 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:33.935503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 985/1966] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:34.416664 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115ba33-972a-4dc0-9d8d-15579f5f4cb3 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:34.428057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115ba33-972a-4dc0-9d8d-15579f5f4cb3 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:34.432773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc9a66-f7e0-4eb2-a0f4-070287bc0868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:34.433448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc9a66-f7e0-4eb2-a0f4-070287bc0868 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:34.433731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc9a66-f7e0-4eb2-a0f4-070287bc0868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:34.434003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc9a66-f7e0-4eb2-a0f4-070287bc0868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:34.483009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:34.509983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc9a66-f7e0-4eb2-a0f4-070287bc0868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:34.511557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc9a66-f7e0-4eb2-a0f4-070287bc0868 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:34.525600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 982/1967] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:34.704415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802162fe-47e3-4ba7-927f-918e8a9c6e64 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:34.715872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802162fe-47e3-4ba7-927f-918e8a9c6e64 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:34.719911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbb85b-d60a-4cfc-9f38-a4a958ba9df3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:34.720519 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbb85b-d60a-4cfc-9f38-a4a958ba9df3 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:34.720917 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbb85b-d60a-4cfc-9f38-a4a958ba9df3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:34.721224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbb85b-d60a-4cfc-9f38-a4a958ba9df3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:34.723119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f8bbb85b-d60a-4cfc-9f38-a4a958ba9df3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:34.801957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbb85b-d60a-4cfc-9f38-a4a958ba9df3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:34.804285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbb85b-d60a-4cfc-9f38-a4a958ba9df3 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:34.822469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 986/1968] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:35.014235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc9a66-f7e0-4eb2-a0f4-070287bc0868 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.015969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-79bc9a66-f7e0-4eb2-a0f4-070287bc0868 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:35.131541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc9a66-f7e0-4eb2-a0f4-070287bc0868 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.151280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.152062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.152597 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.152976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] PATH_INFO: `/v3/users/bf8f853de116404dbc3af797fb2d45b8` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.156089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8f853de116404dbc3af797fb2d45b8)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.158542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.221600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8f853de116404dbc3af797fb2d45b8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:35.230865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8f853de116404dbc3af797fb2d45b8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:35.238573 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8f853de116404dbc3af797fb2d45b8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:35.239365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8f853de116404dbc3af797fb2d45b8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:35.253121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8f853de116404dbc3af797fb2d45b8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:35.264786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 983/1969] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:35 2022] DELETE /identity/v3/users/bf8f853de116404dbc3af797fb2d45b8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:35.269304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e3e8d-3759-4946-b631-cd6b12d9a6e6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.269778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e3e8d-3759-4946-b631-cd6b12d9a6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.270179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e3e8d-3759-4946-b631-cd6b12d9a6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.292176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ac7e3e8d-3759-4946-b631-cd6b12d9a6e6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:35.293692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ac7e3e8d-3759-4946-b631-cd6b12d9a6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:35.329720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:35.370610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 987/1970] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:35.380752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:35.382528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:35.444370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7f57f-0e64-47d1-b46e-65558ba72b33 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:35.448307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99b729-a9a0-47b2-abbc-4c12bb0b5e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:35.449649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99b729-a9a0-47b2-abbc-4c12bb0b5e80 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:35.450132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99b729-a9a0-47b2-abbc-4c12bb0b5e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:35.450421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99b729-a9a0-47b2-abbc-4c12bb0b5e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:35.466849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99b729-a9a0-47b2-abbc-4c12bb0b5e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:35.468599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99b729-a9a0-47b2-abbc-4c12bb0b5e80 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:35.488285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 984/1971] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:36.034050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e3e8d-3759-4946-b631-cd6b12d9a6e6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.035611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ac7e3e8d-3759-4946-b631-cd6b12d9a6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:36.060863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e3e8d-3759-4946-b631-cd6b12d9a6e6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.070701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.071416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.071677 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.074708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] PATH_INFO: `/v3/projects/5252a286c3df4b829775ec0a4fe14698` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.078017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5252a286c3df4b829775ec0a4fe14698)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.080386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.173448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5252a286c3df4b829775ec0a4fe14698', 'request_id': 'req-94dee1d0-2cf6-40b4-adee-8dc7472543ea'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.186696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5252a286c3df4b829775ec0a4fe14698', 'request_id': 'req-94dee1d0-2cf6-40b4-adee-8dc7472543ea'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.198338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5252a286c3df4b829775ec0a4fe14698', 'request_id': 'req-94dee1d0-2cf6-40b4-adee-8dc7472543ea'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.219852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] The token cache is being invalidate because project 5252a286c3df4b829775ec0a4fe14698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:36.220224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.221109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-94dee1d0-2cf6-40b4-adee-8dc7472543ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:36.227549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 988/1972] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:36 2022] DELETE /identity/v3/projects/5252a286c3df4b829775ec0a4fe14698 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:36.229204 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c6dae-8faa-47cc-866a-2eea60f123f2 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.229908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c6dae-8faa-47cc-866a-2eea60f123f2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.230402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c6dae-8faa-47cc-866a-2eea60f123f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.244302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:36.271125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-6b3c6dae-8faa-47cc-866a-2eea60f123f2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:36.276354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6b3c6dae-8faa-47cc-866a-2eea60f123f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:36.402326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3abfe-0482-4435-b921-1455f51ac730 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.402616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3abfe-0482-4435-b921-1455f51ac730 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.402898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3abfe-0482-4435-b921-1455f51ac730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.407063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 985/1973] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:36.435934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-15a3abfe-0482-4435-b921-1455f51ac730 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:36.437576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-15a3abfe-0482-4435-b921-1455f51ac730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:36.470817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 989/1974] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:36.472188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c6dae-8faa-47cc-866a-2eea60f123f2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.493061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c6dae-8faa-47cc-866a-2eea60f123f2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.538499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977983-d2c2-49c1-bef2-c5e0a7061bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.539200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977983-d2c2-49c1-bef2-c5e0a7061bed admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.539499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977983-d2c2-49c1-bef2-c5e0a7061bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.541274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977983-d2c2-49c1-bef2-c5e0a7061bed admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.541274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05977983-d2c2-49c1-bef2-c5e0a7061bed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:36.541274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05977983-d2c2-49c1-bef2-c5e0a7061bed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.543011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05977983-d2c2-49c1-bef2-c5e0a7061bed admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.558178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 986/1975] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:36.563877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3abfe-0482-4435-b921-1455f51ac730 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.585810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3abfe-0482-4435-b921-1455f51ac730 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.598183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfe20b-26f5-4c61-a06c-685088b97a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.599172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfe20b-26f5-4c61-a06c-685088b97a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.599438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfe20b-26f5-4c61-a06c-685088b97a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.599741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfe20b-26f5-4c61-a06c-685088b97a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.600552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfe20b-26f5-4c61-a06c-685088b97a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.604493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfe20b-26f5-4c61-a06c-685088b97a58 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.700413 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 990/1976] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:36 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:36.704841 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977983-d2c2-49c1-bef2-c5e0a7061bed admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.721155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977983-d2c2-49c1-bef2-c5e0a7061bed admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.873242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604d351-2e8d-495c-bb83-cc41d13f0f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.874469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604d351-2e8d-495c-bb83-cc41d13f0f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.874779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604d351-2e8d-495c-bb83-cc41d13f0f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.875056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604d351-2e8d-495c-bb83-cc41d13f0f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.877136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604d351-2e8d-495c-bb83-cc41d13f0f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.880534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604d351-2e8d-495c-bb83-cc41d13f0f48 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.922965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 987/1977] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:36 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:36.923693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfe20b-26f5-4c61-a06c-685088b97a58 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:36.958656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfe20b-26f5-4c61-a06c-685088b97a58 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:36.974631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131f029-b9be-4000-8bb6-910df9142ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:36.975505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f029-b9be-4000-8bb6-910df9142ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:36.976001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f029-b9be-4000-8bb6-910df9142ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:36.976472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f029-b9be-4000-8bb6-910df9142ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:36.977678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131f029-b9be-4000-8bb6-910df9142ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:36.980326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131f029-b9be-4000-8bb6-910df9142ee8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:36.999241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 991/1978] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:37.003674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604d351-2e8d-495c-bb83-cc41d13f0f48 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.017221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604d351-2e8d-495c-bb83-cc41d13f0f48 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.028080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081306-f2f0-4b89-8148-a606fda0349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.029359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081306-f2f0-4b89-8148-a606fda0349f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.029886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081306-f2f0-4b89-8148-a606fda0349f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.030281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081306-f2f0-4b89-8148-a606fda0349f admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.031039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081306-f2f0-4b89-8148-a606fda0349f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.033313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081306-f2f0-4b89-8148-a606fda0349f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.048733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 988/1979] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:37.053914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131f029-b9be-4000-8bb6-910df9142ee8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.067143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131f029-b9be-4000-8bb6-910df9142ee8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.073230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d1bac-7f29-4820-a4fe-f3107f675f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.074137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d1bac-7f29-4820-a4fe-f3107f675f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.074462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d1bac-7f29-4820-a4fe-f3107f675f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.074833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d1bac-7f29-4820-a4fe-f3107f675f36 admin admin] PATH_INFO: `/v3/projects/9a0d2d5c81a44c658be17d51746aec11/users/d3572eab9cd04e51bcbc9efbde734102/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.093304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d1bac-7f29-4820-a4fe-f3107f675f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0d2d5c81a44c658be17d51746aec11, user_id=d3572eab9cd04e51bcbc9efbde734102, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.097173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d1bac-7f29-4820-a4fe-f3107f675f36 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.113378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 992/1980] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:37 2022] PUT /identity/v3/projects/9a0d2d5c81a44c658be17d51746aec11/users/d3572eab9cd04e51bcbc9efbde734102/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:37.126786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73e24-7b81-4bdd-9a5c-c8e2b47cfc35 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.127076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73e24-7b81-4bdd-9a5c-c8e2b47cfc35 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.127933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73e24-7b81-4bdd-9a5c-c8e2b47cfc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.163745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-19b73e24-7b81-4bdd-9a5c-c8e2b47cfc35 None None] MFA Rules not processed for user `d3572eab9cd04e51bcbc9efbde734102`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:37.164610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-19b73e24-7b81-4bdd-9a5c-c8e2b47cfc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.242398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:37.252336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 989/1981] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:37.253651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d1bac-7f29-4820-a4fe-f3107f675f36 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.321288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:37.327850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d1bac-7f29-4820-a4fe-f3107f675f36 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.336336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e008e4-4ca4-47fb-8aa6-3f856c5515f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.336336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e008e4-4ca4-47fb-8aa6-3f856c5515f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.336510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e008e4-4ca4-47fb-8aa6-3f856c5515f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.336858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e008e4-4ca4-47fb-8aa6-3f856c5515f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.338196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e008e4-4ca4-47fb-8aa6-3f856c5515f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.343214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e008e4-4ca4-47fb-8aa6-3f856c5515f3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.379246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 993/1982] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:37.383747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b73e24-7b81-4bdd-9a5c-c8e2b47cfc35 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.395958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b73e24-7b81-4bdd-9a5c-c8e2b47cfc35 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.458624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0f5f1-06bf-4be7-b9dc-d12e8ccbc689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.459247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0f5f1-06bf-4be7-b9dc-d12e8ccbc689 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.459523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0f5f1-06bf-4be7-b9dc-d12e8ccbc689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.459794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0f5f1-06bf-4be7-b9dc-d12e8ccbc689 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.460481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0f5f1-06bf-4be7-b9dc-d12e8ccbc689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.462426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0f5f1-06bf-4be7-b9dc-d12e8ccbc689 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.467263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e008e4-4ca4-47fb-8aa6-3f856c5515f3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.469195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-59e008e4-4ca4-47fb-8aa6-3f856c5515f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.483618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e008e4-4ca4-47fb-8aa6-3f856c5515f3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.490369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 990/1983] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:37.490895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.490895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.490895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.490895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] PATH_INFO: `/v3/users/81d82b245978437f97c2dcdf2ca1ff4c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.491275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d82b245978437f97c2dcdf2ca1ff4c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.491388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0f5f1-06bf-4be7-b9dc-d12e8ccbc689 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.492670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.501744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0f5f1-06bf-4be7-b9dc-d12e8ccbc689 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.506941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce634fe-8cae-424d-976c-dbf95a62bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.507548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce634fe-8cae-424d-976c-dbf95a62bd16 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.507834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce634fe-8cae-424d-976c-dbf95a62bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.508115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce634fe-8cae-424d-976c-dbf95a62bd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.508926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce634fe-8cae-424d-976c-dbf95a62bd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.511168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce634fe-8cae-424d-976c-dbf95a62bd16 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.522549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 991/1984] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:37.526639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce634fe-8cae-424d-976c-dbf95a62bd16 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.536792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce634fe-8cae-424d-976c-dbf95a62bd16 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.541582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c2fee-c7c0-4994-b5b8-4a38a3353adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.542178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c2fee-c7c0-4994-b5b8-4a38a3353adb admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.542510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c2fee-c7c0-4994-b5b8-4a38a3353adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.542784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c2fee-c7c0-4994-b5b8-4a38a3353adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.543489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c2fee-c7c0-4994-b5b8-4a38a3353adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.543893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d82b245978437f97c2dcdf2ca1ff4c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.545069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c2fee-c7c0-4994-b5b8-4a38a3353adb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.554249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d82b245978437f97c2dcdf2ca1ff4c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.562206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d82b245978437f97c2dcdf2ca1ff4c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.562927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d82b245978437f97c2dcdf2ca1ff4c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.563559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e8e4949-5b9b-4246-b809-6ae918b33f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d82b245978437f97c2dcdf2ca1ff4c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:37.564690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 992/1985] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:37.568727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c2fee-c7c0-4994-b5b8-4a38a3353adb admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.570509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-079c2fee-c7c0-4994-b5b8-4a38a3353adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.583484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 994/1986] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:37 2022] DELETE /identity/v3/users/81d82b245978437f97c2dcdf2ca1ff4c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:37.583984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c2fee-c7c0-4994-b5b8-4a38a3353adb admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.587817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0b1ea-86d7-41fa-a87d-fba7d5d6e0c5 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.588111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0b1ea-86d7-41fa-a87d-fba7d5d6e0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.588392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0b1ea-86d7-41fa-a87d-fba7d5d6e0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.608286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ada0b1ea-86d7-41fa-a87d-fba7d5d6e0c5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:37.609536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ada0b1ea-86d7-41fa-a87d-fba7d5d6e0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.642780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9765b6b-592d-41ee-b35e-750fb9ab9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.643704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9765b6b-592d-41ee-b35e-750fb9ab9350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.643984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9765b6b-592d-41ee-b35e-750fb9ab9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.644256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9765b6b-592d-41ee-b35e-750fb9ab9350 admin admin] PATH_INFO: `/v3/projects/b695986638844f3dac4c85b5619986cc/users/a02ac967750f43cc9ef5eee00abba115/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.658221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9765b6b-592d-41ee-b35e-750fb9ab9350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b695986638844f3dac4c85b5619986cc, user_id=a02ac967750f43cc9ef5eee00abba115, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.660861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9765b6b-592d-41ee-b35e-750fb9ab9350 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.672703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 995/1987] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:37.674319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 993/1988] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:37 2022] PUT /identity/v3/projects/b695986638844f3dac4c85b5619986cc/users/a02ac967750f43cc9ef5eee00abba115/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:37.682946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0b1ea-86d7-41fa-a87d-fba7d5d6e0c5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.684576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ada0b1ea-86d7-41fa-a87d-fba7d5d6e0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.685172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f96a3-8140-4898-a002-88f70807e59a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.685501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f96a3-8140-4898-a002-88f70807e59a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.685903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f96a3-8140-4898-a002-88f70807e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.714381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e42f96a3-8140-4898-a002-88f70807e59a None None] MFA Rules not processed for user `a02ac967750f43cc9ef5eee00abba115`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:37.715621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e42f96a3-8140-4898-a002-88f70807e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:37.748849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0b1ea-86d7-41fa-a87d-fba7d5d6e0c5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.753957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:37.760716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:37.792771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 994/1989] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:37.797199 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f96a3-8140-4898-a002-88f70807e59a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.805145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b217-162f-4e4b-9b52-371a8578fcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.805796 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b217-162f-4e4b-9b52-371a8578fcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.806135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b217-162f-4e4b-9b52-371a8578fcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.806904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b217-162f-4e4b-9b52-371a8578fcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.862127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f96a3-8140-4898-a002-88f70807e59a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:37.867243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214efee-5835-4505-b40e-30feab61d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:37.867868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214efee-5835-4505-b40e-30feab61d037 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:37.868166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214efee-5835-4505-b40e-30feab61d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:37.868482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214efee-5835-4505-b40e-30feab61d037 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:37.869666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214efee-5835-4505-b40e-30feab61d037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.871547 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214efee-5835-4505-b40e-30feab61d037 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.873028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174b217-162f-4e4b-9b52-371a8578fcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:37.874568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174b217-162f-4e4b-9b52-371a8578fcb9 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:37.885314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 996/1990] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:37.918196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 995/1991] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:37.919603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b217-162f-4e4b-9b52-371a8578fcb9 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:37.937972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b217-162f-4e4b-9b52-371a8578fcb9 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.039036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaabab-d8fc-4923-9c1d-924cf1c3205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.039991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaabab-d8fc-4923-9c1d-924cf1c3205c admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.040241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaabab-d8fc-4923-9c1d-924cf1c3205c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.041278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaabab-d8fc-4923-9c1d-924cf1c3205c admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.042255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaabab-d8fc-4923-9c1d-924cf1c3205c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.044478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaabab-d8fc-4923-9c1d-924cf1c3205c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.073163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 997/1992] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:37 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:38.077196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214efee-5835-4505-b40e-30feab61d037 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.090875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214efee-5835-4505-b40e-30feab61d037 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.098891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af2183-b4e7-4945-a053-515ab7867721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.099974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af2183-b4e7-4945-a053-515ab7867721 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.100228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af2183-b4e7-4945-a053-515ab7867721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.100786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af2183-b4e7-4945-a053-515ab7867721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.101774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af2183-b4e7-4945-a053-515ab7867721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.105023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af2183-b4e7-4945-a053-515ab7867721 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.120518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 996/1993] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:38.124483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaabab-d8fc-4923-9c1d-924cf1c3205c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.137830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaabab-d8fc-4923-9c1d-924cf1c3205c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.144187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e16940-d404-4125-901f-cef9c4e3ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.145100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e16940-d404-4125-901f-cef9c4e3ab25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.145578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e16940-d404-4125-901f-cef9c4e3ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.146042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e16940-d404-4125-901f-cef9c4e3ab25 admin admin] PATH_INFO: `/v3/projects/92f4d2a28cbf43f482ed22d34507f99d/users/2c9d0c347b7e42fe824995edec08acfe/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.185879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e16940-d404-4125-901f-cef9c4e3ab25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f4d2a28cbf43f482ed22d34507f99d, user_id=2c9d0c347b7e42fe824995edec08acfe, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.190627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e16940-d404-4125-901f-cef9c4e3ab25 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.229169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 998/1994] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:38 2022] PUT /identity/v3/projects/92f4d2a28cbf43f482ed22d34507f99d/users/2c9d0c347b7e42fe824995edec08acfe/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:38.229507 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af2183-b4e7-4945-a053-515ab7867721 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.240487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af2183-b4e7-4945-a053-515ab7867721 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.348277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fd699-4b2c-4cdd-8726-eef0892ef9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.349396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fd699-4b2c-4cdd-8726-eef0892ef9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.349878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fd699-4b2c-4cdd-8726-eef0892ef9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.354283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fd699-4b2c-4cdd-8726-eef0892ef9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.357016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fd699-4b2c-4cdd-8726-eef0892ef9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.360964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fd699-4b2c-4cdd-8726-eef0892ef9b8 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.374811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 997/1995] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:38.378838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e16940-d404-4125-901f-cef9c4e3ab25 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.390966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e16940-d404-4125-901f-cef9c4e3ab25 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.396633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fd699-4b2c-4cdd-8726-eef0892ef9b8 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.398819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ce7fd699-4b2c-4cdd-8726-eef0892ef9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.402096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f99c64-74e9-4a57-8eee-5caf812db77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.403273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99c64-74e9-4a57-8eee-5caf812db77e admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.403751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99c64-74e9-4a57-8eee-5caf812db77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.404044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f99c64-74e9-4a57-8eee-5caf812db77e admin admin] PATH_INFO: `/v3/projects/92f4d2a28cbf43f482ed22d34507f99d/users/2c9d0c347b7e42fe824995edec08acfe/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.407062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f99c64-74e9-4a57-8eee-5caf812db77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f4d2a28cbf43f482ed22d34507f99d, user_id=2c9d0c347b7e42fe824995edec08acfe, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.410696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f99c64-74e9-4a57-8eee-5caf812db77e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.413371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fd699-4b2c-4cdd-8726-eef0892ef9b8 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.418933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.419581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.420069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.420173 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] PATH_INFO: `/v3/users/4d47ffe54cd946b4bdf7b35f2e1fd1fa` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.421297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d47ffe54cd946b4bdf7b35f2e1fd1fa)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.423468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.427126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 999/1996] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:38 2022] PUT /identity/v3/projects/92f4d2a28cbf43f482ed22d34507f99d/users/2c9d0c347b7e42fe824995edec08acfe/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:38.438413 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3efca6-f227-4c51-af81-dee03c18c132 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.438702 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3efca6-f227-4c51-af81-dee03c18c132 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.438967 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3efca6-f227-4c51-af81-dee03c18c132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.461863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:38.473734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7c3efca6-f227-4c51-af81-dee03c18c132 None None] MFA Rules not processed for user `2c9d0c347b7e42fe824995edec08acfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:38.476030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7c3efca6-f227-4c51-af81-dee03c18c132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.484081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:38.487487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d47ffe54cd946b4bdf7b35f2e1fd1fa'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.497820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d47ffe54cd946b4bdf7b35f2e1fd1fa'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.511353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d47ffe54cd946b4bdf7b35f2e1fd1fa'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.512618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d47ffe54cd946b4bdf7b35f2e1fd1fa'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.533628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79667f34-c768-41e6-8e9f-bb8f64e98c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d47ffe54cd946b4bdf7b35f2e1fd1fa'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.541311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 998/1997] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:38 2022] DELETE /identity/v3/users/4d47ffe54cd946b4bdf7b35f2e1fd1fa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:38.547840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9055-a862-4e85-abbb-e4d24109a286 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.548579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9055-a862-4e85-abbb-e4d24109a286 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.548579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c9055-a862-4e85-abbb-e4d24109a286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.583511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-6a5c9055-a862-4e85-abbb-e4d24109a286 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:38.585041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6a5c9055-a862-4e85-abbb-e4d24109a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.610263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1000/1998] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:38.610263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3efca6-f227-4c51-af81-dee03c18c132 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.610263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7c3efca6-f227-4c51-af81-dee03c18c132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.648118 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 999/1999] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:38.648803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9055-a862-4e85-abbb-e4d24109a286 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.650123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6a5c9055-a862-4e85-abbb-e4d24109a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.679465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3efca6-f227-4c51-af81-dee03c18c132 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.684916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.685597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.685879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.686152 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] PATH_INFO: `/v3/projects/136641159f694c8fbb21aa9444be3f8d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.687337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] RBAC: Authorizing `identity:delete_project(project_id=136641159f694c8fbb21aa9444be3f8d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.689249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.706232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c9055-a862-4e85-abbb-e4d24109a286 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.709793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce1690-0c6d-4014-b1f5-4fffecfc0d53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.710402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce1690-0c6d-4014-b1f5-4fffecfc0d53 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.710681 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce1690-0c6d-4014-b1f5-4fffecfc0d53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.710950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce1690-0c6d-4014-b1f5-4fffecfc0d53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.712932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-44ce1690-0c6d-4014-b1f5-4fffecfc0d53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.736050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136641159f694c8fbb21aa9444be3f8d', 'request_id': 'req-5d69a8ca-e2d4-4800-9301-a97afb11bade'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.746641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136641159f694c8fbb21aa9444be3f8d', 'request_id': 'req-5d69a8ca-e2d4-4800-9301-a97afb11bade'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.753532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136641159f694c8fbb21aa9444be3f8d', 'request_id': 'req-5d69a8ca-e2d4-4800-9301-a97afb11bade'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.767338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] The token cache is being invalidate because project 136641159f694c8fbb21aa9444be3f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:38.767824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.768519 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.773125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1001/2000] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:38 2022] DELETE /identity/v3/projects/136641159f694c8fbb21aa9444be3f8d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:38.773125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.773125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.789918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce1690-0c6d-4014-b1f5-4fffecfc0d53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.791879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce1690-0c6d-4014-b1f5-4fffecfc0d53 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.801364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1000/2001] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:38.802066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce1690-0c6d-4014-b1f5-4fffecfc0d53 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:38.808166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:38.813627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce1690-0c6d-4014-b1f5-4fffecfc0d53 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.830855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:38.849677 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69a8ca-e2d4-4800-9301-a97afb11bade admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:38.856039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.857012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.857546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.858048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.860303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:38.889964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:38.890629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:38.890909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:38.891185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] PATH_INFO: `/v3/users/bf24941a0b64439cba9eeacffd8cf412` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:38.892531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf24941a0b64439cba9eeacffd8cf412)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.894731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.937063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:38.938545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:38.949370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1002/2002] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:38.960324 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf24941a0b64439cba9eeacffd8cf412'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.971655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf24941a0b64439cba9eeacffd8cf412'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.984108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf24941a0b64439cba9eeacffd8cf412'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:38.985139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf24941a0b64439cba9eeacffd8cf412'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:39.001047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf24941a0b64439cba9eeacffd8cf412'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:39.013470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1001/2003] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:38 2022] DELETE /identity/v3/users/bf24941a0b64439cba9eeacffd8cf412 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:39.707940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:39.710514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:39.746483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbab3b2-9197-4f60-8b7b-1d408cce0d1e service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:39.776330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:39.778550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:39.879922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:39.879922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:39.879922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:39.879922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] PATH_INFO: `/v3/projects/f804159fee774bdc8d4dc3611357672b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:39.880505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f804159fee774bdc8d4dc3611357672b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:39.882856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:39.905778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d95dee-1ca0-4994-8ad8-dbdaeda10bff admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:39.910605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:39.911370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:39.911750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:39.912125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] PATH_INFO: `/v3/projects/94d33d6bd5c84888b48f99c71dc43cd7` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:39.913914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d33d6bd5c84888b48f99c71dc43cd7)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:39.915609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:39.973763 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f804159fee774bdc8d4dc3611357672b', 'request_id': 'req-388b3515-7d86-410a-bab6-6fedd1ff0245'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:39.977167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:39.984106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f804159fee774bdc8d4dc3611357672b', 'request_id': 'req-388b3515-7d86-410a-bab6-6fedd1ff0245'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:39.993999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d33d6bd5c84888b48f99c71dc43cd7', 'request_id': 'req-ea21de11-7eee-456a-be5c-b7a878963507'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:39.996002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f804159fee774bdc8d4dc3611357672b', 'request_id': 'req-388b3515-7d86-410a-bab6-6fedd1ff0245'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.003299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d33d6bd5c84888b48f99c71dc43cd7', 'request_id': 'req-ea21de11-7eee-456a-be5c-b7a878963507'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.012193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d33d6bd5c84888b48f99c71dc43cd7', 'request_id': 'req-ea21de11-7eee-456a-be5c-b7a878963507'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.021379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] The token cache is being invalidate because project f804159fee774bdc8d4dc3611357672b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:40.021379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.021939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.023520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1003/2004] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:39 2022] DELETE /identity/v3/projects/f804159fee774bdc8d4dc3611357672b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:40.027606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:40.029077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:40.030253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] The token cache is being invalidate because project 94d33d6bd5c84888b48f99c71dc43cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:40.030530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.031276 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.032974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1002/2005] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:39 2022] DELETE /identity/v3/projects/94d33d6bd5c84888b48f99c71dc43cd7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:40.036997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:40.038500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:40.041425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:40.112726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b3515-7d86-410a-bab6-6fedd1ff0245 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:40.125715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:40.126374 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:40.126653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:40.126925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] PATH_INFO: `/v3/users/9d3bc5b0ccc6415a89e7b62783a1f307` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:40.128377 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3bc5b0ccc6415a89e7b62783a1f307)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:40.130508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:40.136257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21de11-7eee-456a-be5c-b7a878963507 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:40.148958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:40.150089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:40.150347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:40.156165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] PATH_INFO: `/v3/users/0e40d3a398e44787b68c6c982cd5fda3` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:40.157669 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e40d3a398e44787b68c6c982cd5fda3)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:40.159626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:40.189061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3bc5b0ccc6415a89e7b62783a1f307'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.197858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3bc5b0ccc6415a89e7b62783a1f307'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.206642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3bc5b0ccc6415a89e7b62783a1f307'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.207693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3bc5b0ccc6415a89e7b62783a1f307'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.208414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3bc5b0ccc6415a89e7b62783a1f307'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.218934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e40d3a398e44787b68c6c982cd5fda3'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.229492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1004/2006] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:40 2022] DELETE /identity/v3/users/9d3bc5b0ccc6415a89e7b62783a1f307 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:40.230903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e40d3a398e44787b68c6c982cd5fda3'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.245309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e40d3a398e44787b68c6c982cd5fda3'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.246174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e40d3a398e44787b68c6c982cd5fda3'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.261737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e40d3a398e44787b68c6c982cd5fda3'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.271568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1003/2007] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:40 2022] DELETE /identity/v3/users/0e40d3a398e44787b68c6c982cd5fda3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:40.579492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:40.581544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:40.679655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d235f-f115-4a9c-a912-1946cf8b6b63 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:40.725915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:40.727580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:40.750481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:40.764268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:40.765023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:40.765415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:40.765798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:40.767935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:40.816149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:40.844321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81cd01-746e-4ddf-a8b5-c6b6111e3498 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:40.850531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:40.851459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:40.851895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:40.852310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] PATH_INFO: `/v3/projects/a6d0756e08f94849a7b3f5d07e270371` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:40.856105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d0756e08f94849a7b3f5d07e270371)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:40.858358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:40.859735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:40.860163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:40.877575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1005/2008] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:40.878681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:40.882400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:40.900052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a6c4-df03-424e-92d2-71ecd3038db1 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:40.905766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:40.906438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:40.906776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:40.907091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] PATH_INFO: `/v3/projects/58ff256310ad4af2b8388b5a64082eee` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:40.908344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ff256310ad4af2b8388b5a64082eee)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:40.910317 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:40.982108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d0756e08f94849a7b3f5d07e270371', 'request_id': 'req-a7444c20-c744-4aaa-8912-84257538ee2e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.989107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ff256310ad4af2b8388b5a64082eee', 'request_id': 'req-f0785eb8-696f-4099-b1ef-74f949d13816'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:40.993125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d0756e08f94849a7b3f5d07e270371', 'request_id': 'req-a7444c20-c744-4aaa-8912-84257538ee2e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.001801 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ff256310ad4af2b8388b5a64082eee', 'request_id': 'req-f0785eb8-696f-4099-b1ef-74f949d13816'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.001981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d0756e08f94849a7b3f5d07e270371', 'request_id': 'req-a7444c20-c744-4aaa-8912-84257538ee2e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.009837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ff256310ad4af2b8388b5a64082eee', 'request_id': 'req-f0785eb8-696f-4099-b1ef-74f949d13816'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.017974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] The token cache is being invalidate because project a6d0756e08f94849a7b3f5d07e270371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:41.018469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.019416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a7444c20-c744-4aaa-8912-84257538ee2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.021392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1004/2009] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:40 2022] DELETE /identity/v3/projects/a6d0756e08f94849a7b3f5d07e270371 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:41.027554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15896a40-c30f-40a2-9f12-8cd9b27c075b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.028029 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15896a40-c30f-40a2-9f12-8cd9b27c075b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.028371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15896a40-c30f-40a2-9f12-8cd9b27c075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.029431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] The token cache is being invalidate because project 58ff256310ad4af2b8388b5a64082eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:41.029911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.031662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.033574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1006/2010] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:40 2022] DELETE /identity/v3/projects/58ff256310ad4af2b8388b5a64082eee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:41.038409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.041172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.050162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-15896a40-c30f-40a2-9f12-8cd9b27c075b None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:41.051431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-15896a40-c30f-40a2-9f12-8cd9b27c075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.141487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1005/2011] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:41.155777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cbf19-995e-4676-b369-49a08b9c1bea None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.155994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cbf19-995e-4676-b369-49a08b9c1bea None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.156265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cbf19-995e-4676-b369-49a08b9c1bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.168524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0785eb8-696f-4099-b1ef-74f949d13816 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.175756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.176435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.176714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.176984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] PATH_INFO: `/v3/users/95b02f7013744f168a18c5e68025148e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.178400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b02f7013744f168a18c5e68025148e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.180333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.191663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-386cbf19-995e-4676-b369-49a08b9c1bea None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:41.192969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-386cbf19-995e-4676-b369-49a08b9c1bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.203619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1006/2012] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:41.207262 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:41.213621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cbf19-995e-4676-b369-49a08b9c1bea None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.227317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cbf19-995e-4676-b369-49a08b9c1bea None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.233254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a939c-25f7-4651-99c0-0c618325674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.233916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a939c-25f7-4651-99c0-0c618325674f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.234190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a939c-25f7-4651-99c0-0c618325674f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.234468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a939c-25f7-4651-99c0-0c618325674f admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.235789 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a939c-25f7-4651-99c0-0c618325674f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:41.236084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a939c-25f7-4651-99c0-0c618325674f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.237961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a939c-25f7-4651-99c0-0c618325674f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.250202 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b02f7013744f168a18c5e68025148e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.252826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1007/2013] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:41.257536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a939c-25f7-4651-99c0-0c618325674f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.263626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b02f7013744f168a18c5e68025148e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.272863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a939c-25f7-4651-99c0-0c618325674f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.275592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b02f7013744f168a18c5e68025148e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.276674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b02f7013744f168a18c5e68025148e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.277761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b02f7013744f168a18c5e68025148e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.279987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d091-3af8-4c17-b4f6-0dc00de44c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.280813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d091-3af8-4c17-b4f6-0dc00de44c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.281406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d091-3af8-4c17-b4f6-0dc00de44c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.281993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d091-3af8-4c17-b4f6-0dc00de44c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.282954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4d091-3af8-4c17-b4f6-0dc00de44c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.285394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4d091-3af8-4c17-b4f6-0dc00de44c97 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.306019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1007/2014] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:41 2022] DELETE /identity/v3/users/95b02f7013744f168a18c5e68025148e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:41.342055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1008/2015] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:41 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:41.343446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.346914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.438344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adc1c5-7f98-44f6-88d6-f7848dfa030c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.638217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e0e2-b8f2-442c-a037-811276de82cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.638931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e0e2-b8f2-442c-a037-811276de82cc admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.639126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e0e2-b8f2-442c-a037-811276de82cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.639403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e0e2-b8f2-442c-a037-811276de82cc admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.640081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e0e2-b8f2-442c-a037-811276de82cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.642080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e0e2-b8f2-442c-a037-811276de82cc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.690191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1008/2016] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:41 2022] POST /identity/v3/users => generated 284 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:41.692099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d091-3af8-4c17-b4f6-0dc00de44c97 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.709935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d091-3af8-4c17-b4f6-0dc00de44c97 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.718758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828224-13c2-4fe0-9e24-7ef99b15ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.719774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828224-13c2-4fe0-9e24-7ef99b15ff18 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.720130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828224-13c2-4fe0-9e24-7ef99b15ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.720429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e828224-13c2-4fe0-9e24-7ef99b15ff18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.722694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828224-13c2-4fe0-9e24-7ef99b15ff18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.724300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e828224-13c2-4fe0-9e24-7ef99b15ff18 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.736416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1009/2017] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:41.740510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e0e2-b8f2-442c-a037-811276de82cc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.755495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e0e2-b8f2-442c-a037-811276de82cc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.766227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebab53-8c8d-449b-b2b0-1fdca3e69b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.766868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebab53-8c8d-449b-b2b0-1fdca3e69b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.767428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebab53-8c8d-449b-b2b0-1fdca3e69b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.770350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebab53-8c8d-449b-b2b0-1fdca3e69b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.771370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebab53-8c8d-449b-b2b0-1fdca3e69b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.772973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebab53-8c8d-449b-b2b0-1fdca3e69b54 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.798617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828224-13c2-4fe0-9e24-7ef99b15ff18 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.800648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4e828224-13c2-4fe0-9e24-7ef99b15ff18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.815300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1009/2018] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:41.819543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebab53-8c8d-449b-b2b0-1fdca3e69b54 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.831417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e828224-13c2-4fe0-9e24-7ef99b15ff18 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.837504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.838532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.839033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.839437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] PATH_INFO: `/v3/projects/fb34f27366504c5fae507bee28e13819` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.841069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb34f27366504c5fae507bee28e13819)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.842915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.852231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebab53-8c8d-449b-b2b0-1fdca3e69b54 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:41.859252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa1577-0f9c-47df-a963-034e60507048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:41.860111 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa1577-0f9c-47df-a963-034e60507048 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.861234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa1577-0f9c-47df-a963-034e60507048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.861694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa1577-0f9c-47df-a963-034e60507048 admin admin] PATH_INFO: `/v3/projects/b217aa95460b43d4bd9aa4e8ccd48414/users/d8f806e5539d42c5b987f0d68481ea0a/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.864984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:41.884911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa1577-0f9c-47df-a963-034e60507048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b217aa95460b43d4bd9aa4e8ccd48414, user_id=d8f806e5539d42c5b987f0d68481ea0a, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:41.888372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa1577-0f9c-47df-a963-034e60507048 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:41.904023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:41.912337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1010/2019] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:41 2022] PUT /identity/v3/projects/b217aa95460b43d4bd9aa4e8ccd48414/users/d8f806e5539d42c5b987f0d68481ea0a/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:41.914797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb34f27366504c5fae507bee28e13819', 'request_id': 'req-a06a1492-d080-48fd-9be2-71d215b6d99a'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.926350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa1577-0f9c-47df-a963-034e60507048 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:41.930518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb34f27366504c5fae507bee28e13819', 'request_id': 'req-a06a1492-d080-48fd-9be2-71d215b6d99a'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.936806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-76aa1577-0f9c-47df-a963-034e60507048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:41.940154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb34f27366504c5fae507bee28e13819', 'request_id': 'req-a06a1492-d080-48fd-9be2-71d215b6d99a'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.953817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] The token cache is being invalidate because project fb34f27366504c5fae507bee28e13819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:41.954131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.955122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a06a1492-d080-48fd-9be2-71d215b6d99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:41.956746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1010/2020] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:41 2022] DELETE /identity/v3/projects/fb34f27366504c5fae507bee28e13819 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:41.958002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6650e9-caa0-4c08-bef0-741350211b71 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:41.958316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6650e9-caa0-4c08-bef0-741350211b71 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:41.958558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6650e9-caa0-4c08-bef0-741350211b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:41.994348 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3d6650e9-caa0-4c08-bef0-741350211b71 None None] MFA Rules not processed for user `d8f806e5539d42c5b987f0d68481ea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:41.996166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3d6650e9-caa0-4c08-bef0-741350211b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.005169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa1577-0f9c-47df-a963-034e60507048 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.009880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.010634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.010936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.011230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.013953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.077798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1011/2021] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:42.079268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca128be-a196-43a6-b3b1-858cf6ab2fcb None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.079676 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca128be-a196-43a6-b3b1-858cf6ab2fcb None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.080023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca128be-a196-43a6-b3b1-858cf6ab2fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.089996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.091618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.101687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-7ca128be-a196-43a6-b3b1-858cf6ab2fcb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:42.102736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1011/2022] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:42.103763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7ca128be-a196-43a6-b3b1-858cf6ab2fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.104096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.105728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.190090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1012/2023] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:42.201258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396b678-1f1b-47eb-bb12-bc131790b78a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.201659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396b678-1f1b-47eb-bb12-bc131790b78a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.201986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396b678-1f1b-47eb-bb12-bc131790b78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.215056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96178c-feb1-4ebc-90a1-d0d20a86758e service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.230451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd2035-d62c-4f2e-8780-77531e877961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.231508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2035-d62c-4f2e-8780-77531e877961 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.231956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2035-d62c-4f2e-8780-77531e877961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.232366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2035-d62c-4f2e-8780-77531e877961 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.233400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd2035-d62c-4f2e-8780-77531e877961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.233639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-d396b678-1f1b-47eb-bb12-bc131790b78a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:42.239279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd2035-d62c-4f2e-8780-77531e877961 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.244909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d396b678-1f1b-47eb-bb12-bc131790b78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.264571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1013/2024] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:42.269199 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396b678-1f1b-47eb-bb12-bc131790b78a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.281143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396b678-1f1b-47eb-bb12-bc131790b78a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.287371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3295-eda1-4b9b-a0e2-8732770b05bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.288932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3295-eda1-4b9b-a0e2-8732770b05bd admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.289366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3295-eda1-4b9b-a0e2-8732770b05bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.289713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3295-eda1-4b9b-a0e2-8732770b05bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.290763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c3295-eda1-4b9b-a0e2-8732770b05bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:42.291142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c3295-eda1-4b9b-a0e2-8732770b05bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.292979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c3295-eda1-4b9b-a0e2-8732770b05bd admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.299068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1012/2025] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:42.300183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd2035-d62c-4f2e-8780-77531e877961 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.318822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1014/2026] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:42.325070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3295-eda1-4b9b-a0e2-8732770b05bd admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.338558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3295-eda1-4b9b-a0e2-8732770b05bd admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.358976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:42.361150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:42.403931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd2035-d62c-4f2e-8780-77531e877961 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.410414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e712c-5506-4c87-97d0-7afe20ac2f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.411679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e712c-5506-4c87-97d0-7afe20ac2f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.411963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e712c-5506-4c87-97d0-7afe20ac2f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.412267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e712c-5506-4c87-97d0-7afe20ac2f2b admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.413046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e712c-5506-4c87-97d0-7afe20ac2f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.415603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e712c-5506-4c87-97d0-7afe20ac2f2b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.439298 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a13af6-3361-4d5d-a9ad-6c9d07ea37fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.440176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a13af6-3361-4d5d-a9ad-6c9d07ea37fe admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.440589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a13af6-3361-4d5d-a9ad-6c9d07ea37fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.441006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a13af6-3361-4d5d-a9ad-6c9d07ea37fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.441864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a13af6-3361-4d5d-a9ad-6c9d07ea37fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.444131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a13af6-3361-4d5d-a9ad-6c9d07ea37fe admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.450866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1013/2027] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:42.454893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e712c-5506-4c87-97d0-7afe20ac2f2b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.465891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e712c-5506-4c87-97d0-7afe20ac2f2b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.471562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2f9da-b50b-42cc-9f53-3907b2f4fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.472369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2f9da-b50b-42cc-9f53-3907b2f4fc91 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.472642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2f9da-b50b-42cc-9f53-3907b2f4fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.472913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2f9da-b50b-42cc-9f53-3907b2f4fc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.473642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2f9da-b50b-42cc-9f53-3907b2f4fc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.475242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2f9da-b50b-42cc-9f53-3907b2f4fc91 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.485915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1015/2028] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:42.489954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1014/2029] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:42.490963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a13af6-3361-4d5d-a9ad-6c9d07ea37fe admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.495843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2f9da-b50b-42cc-9f53-3907b2f4fc91 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.509567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2f9da-b50b-42cc-9f53-3907b2f4fc91 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.599713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26064718-854b-43d0-b11a-ac1e10170b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.600535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26064718-854b-43d0-b11a-ac1e10170b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.600924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26064718-854b-43d0-b11a-ac1e10170b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.601694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26064718-854b-43d0-b11a-ac1e10170b18 admin admin] PATH_INFO: `/v3/projects/9eac64f25b184a0caad4c61edcb0700a/users/562ff5091fcd4a84bc434ca45262bf84/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.603928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a13af6-3361-4d5d-a9ad-6c9d07ea37fe admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.608711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83fde-f134-4e47-bf11-06322e6f7b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.609370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83fde-f134-4e47-bf11-06322e6f7b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.609689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83fde-f134-4e47-bf11-06322e6f7b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.609963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83fde-f134-4e47-bf11-06322e6f7b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.610625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83fde-f134-4e47-bf11-06322e6f7b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.612671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83fde-f134-4e47-bf11-06322e6f7b0a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.621881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26064718-854b-43d0-b11a-ac1e10170b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eac64f25b184a0caad4c61edcb0700a, user_id=562ff5091fcd4a84bc434ca45262bf84, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.626210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26064718-854b-43d0-b11a-ac1e10170b18 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.638996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1016/2030] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:42.642762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1015/2031] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:42 2022] PUT /identity/v3/projects/9eac64f25b184a0caad4c61edcb0700a/users/562ff5091fcd4a84bc434ca45262bf84/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:42.646498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83fde-f134-4e47-bf11-06322e6f7b0a admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.646744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26064718-854b-43d0-b11a-ac1e10170b18 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.662713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83fde-f134-4e47-bf11-06322e6f7b0a admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.726666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26064718-854b-43d0-b11a-ac1e10170b18 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.734421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e623493-9e81-497c-8eef-3b2605530f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.735047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e623493-9e81-497c-8eef-3b2605530f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.735320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e623493-9e81-497c-8eef-3b2605530f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.735656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e623493-9e81-497c-8eef-3b2605530f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.736331 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e623493-9e81-497c-8eef-3b2605530f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.738024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e623493-9e81-497c-8eef-3b2605530f51 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.741425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f11eb-a2c3-4d45-980c-915257877b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.742182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f11eb-a2c3-4d45-980c-915257877b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.742667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f11eb-a2c3-4d45-980c-915257877b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.743039 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f11eb-a2c3-4d45-980c-915257877b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.744392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f11eb-a2c3-4d45-980c-915257877b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.746290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f11eb-a2c3-4d45-980c-915257877b18 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.752665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1016/2032] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:42.753733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e623493-9e81-497c-8eef-3b2605530f51 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.761727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1017/2033] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:42.763074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f11eb-a2c3-4d45-980c-915257877b18 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.765809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e623493-9e81-497c-8eef-3b2605530f51 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.770444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5855-f551-4331-b7dc-c3db7cb59bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.771401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5855-f551-4331-b7dc-c3db7cb59bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.771719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5855-f551-4331-b7dc-c3db7cb59bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.772000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd5855-f551-4331-b7dc-c3db7cb59bea admin admin] PATH_INFO: `/v3/projects/9eac64f25b184a0caad4c61edcb0700a/users/562ff5091fcd4a84bc434ca45262bf84/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.774132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd5855-f551-4331-b7dc-c3db7cb59bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eac64f25b184a0caad4c61edcb0700a, user_id=562ff5091fcd4a84bc434ca45262bf84, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.774238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f11eb-a2c3-4d45-980c-915257877b18 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.777049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd5855-f551-4331-b7dc-c3db7cb59bea admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.779011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7f430-355b-4a40-ae86-12c208627213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.779580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7f430-355b-4a40-ae86-12c208627213 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.779925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7f430-355b-4a40-ae86-12c208627213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.780195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7f430-355b-4a40-ae86-12c208627213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.780871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7f430-355b-4a40-ae86-12c208627213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.782519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7f430-355b-4a40-ae86-12c208627213 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.797276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1017/2034] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:42 2022] PUT /identity/v3/projects/9eac64f25b184a0caad4c61edcb0700a/users/562ff5091fcd4a84bc434ca45262bf84/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:42.797500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1018/2035] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:42.798322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5855-f551-4331-b7dc-c3db7cb59bea admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.799303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f673ee-d4b2-4b6a-946c-85000b8e80e3 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.799303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f673ee-d4b2-4b6a-946c-85000b8e80e3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.799570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f673ee-d4b2-4b6a-946c-85000b8e80e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.825944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:42.831409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-87f673ee-d4b2-4b6a-946c-85000b8e80e3 None None] MFA Rules not processed for user `562ff5091fcd4a84bc434ca45262bf84`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:42.832634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-87f673ee-d4b2-4b6a-946c-85000b8e80e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.837568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:42.879546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd5855-f551-4331-b7dc-c3db7cb59bea admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:42.886813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a2853-dad2-497d-bde0-f28fbd86265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:42.887574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a2853-dad2-497d-bde0-f28fbd86265e admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.887946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a2853-dad2-497d-bde0-f28fbd86265e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.888271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a2853-dad2-497d-bde0-f28fbd86265e admin admin] PATH_INFO: `/v3/projects/34aa7542beb8410a8d125b176339e859/users/5b202a5fd27247ea98b1c52b0c90698f/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.904233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a2853-dad2-497d-bde0-f28fbd86265e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34aa7542beb8410a8d125b176339e859, user_id=5b202a5fd27247ea98b1c52b0c90698f, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:42.906988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a2853-dad2-497d-bde0-f28fbd86265e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:42.916717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1019/2036] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:42.924519 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1018/2037] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:42 2022] PUT /identity/v3/projects/34aa7542beb8410a8d125b176339e859/users/5b202a5fd27247ea98b1c52b0c90698f/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:42.930543 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f673ee-d4b2-4b6a-946c-85000b8e80e3 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:42.932894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-87f673ee-d4b2-4b6a-946c-85000b8e80e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:42.938590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965226c-ebca-44e8-a374-c63405dca8de None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:42.939196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965226c-ebca-44e8-a374-c63405dca8de None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:42.939859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965226c-ebca-44e8-a374-c63405dca8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:42.985833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c965226c-ebca-44e8-a374-c63405dca8de None None] MFA Rules not processed for user `5b202a5fd27247ea98b1c52b0c90698f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:42.987212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c965226c-ebca-44e8-a374-c63405dca8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.019454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f673ee-d4b2-4b6a-946c-85000b8e80e3 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.075451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1019/2038] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:43.093456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93ace1-d4a5-47f5-bcae-13095281c45f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.094179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93ace1-d4a5-47f5-bcae-13095281c45f service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.094462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93ace1-d4a5-47f5-bcae-13095281c45f service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.094745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93ace1-d4a5-47f5-bcae-13095281c45f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.117261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965226c-ebca-44e8-a374-c63405dca8de None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:43.119417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c965226c-ebca-44e8-a374-c63405dca8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.132949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965226c-ebca-44e8-a374-c63405dca8de None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.136956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54ad5e-9aa1-4650-a384-1f024ee6cba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.137637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54ad5e-9aa1-4650-a384-1f024ee6cba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.137923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54ad5e-9aa1-4650-a384-1f024ee6cba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.138190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54ad5e-9aa1-4650-a384-1f024ee6cba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.150302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54ad5e-9aa1-4650-a384-1f024ee6cba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.151756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54ad5e-9aa1-4650-a384-1f024ee6cba5 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:43.162324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1020/2039] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:43.184042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93ace1-d4a5-47f5-bcae-13095281c45f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.185628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93ace1-d4a5-47f5-bcae-13095281c45f service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:43.196642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1020/2040] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:43.270376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54ad5e-9aa1-4650-a384-1f024ee6cba5 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:43.271794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bb54ad5e-9aa1-4650-a384-1f024ee6cba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.377000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93ace1-d4a5-47f5-bcae-13095281c45f service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:43.383264 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54ad5e-9aa1-4650-a384-1f024ee6cba5 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.390220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93ace1-d4a5-47f5-bcae-13095281c45f service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.393206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.394020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.394275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.394682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] PATH_INFO: `/v3/users/3fd3c8e7a6d74a389ddc8e56ff555858` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.395051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c51da3-b028-4c9d-a23c-403858f6bad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.395718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c51da3-b028-4c9d-a23c-403858f6bad3 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.396121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd3c8e7a6d74a389ddc8e56ff555858)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.396230 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c51da3-b028-4c9d-a23c-403858f6bad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.396429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c51da3-b028-4c9d-a23c-403858f6bad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.398080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:43.401894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:43.430104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:43.480856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c51da3-b028-4c9d-a23c-403858f6bad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.482358 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c51da3-b028-4c9d-a23c-403858f6bad3 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:43.504249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1021/2041] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:43.506152 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd3c8e7a6d74a389ddc8e56ff555858'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:43.529605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd3c8e7a6d74a389ddc8e56ff555858'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:43.541686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd3c8e7a6d74a389ddc8e56ff555858'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:43.545962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd3c8e7a6d74a389ddc8e56ff555858'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:43.546649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd3c8e7a6d74a389ddc8e56ff555858'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:43.576001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1021/2042] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:43 2022] DELETE /identity/v3/users/3fd3c8e7a6d74a389ddc8e56ff555858 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:43.576134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122124e-678f-4466-87a3-b89029e2051d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.576553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122124e-678f-4466-87a3-b89029e2051d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.576833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122124e-678f-4466-87a3-b89029e2051d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.609836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f122124e-678f-4466-87a3-b89029e2051d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:43.611937 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f122124e-678f-4466-87a3-b89029e2051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.710097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1022/2043] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:43.721927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:43.723416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:43.815479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e73772-572d-4e3c-b518-47968bc399f2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:43.825742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe4767-5e65-4df2-9906-605d482e71c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:43.827567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe4767-5e65-4df2-9906-605d482e71c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:43.828422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe4767-5e65-4df2-9906-605d482e71c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:43.828882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe4767-5e65-4df2-9906-605d482e71c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:43.844295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe4767-5e65-4df2-9906-605d482e71c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:43.846470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe4767-5e65-4df2-9906-605d482e71c5 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:43.861983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1022/2044] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:44.309968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122124e-678f-4466-87a3-b89029e2051d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:44.311999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f122124e-678f-4466-87a3-b89029e2051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:44.339319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122124e-678f-4466-87a3-b89029e2051d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:44.361696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:44.362629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.363087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.363507 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] PATH_INFO: `/v3/projects/3ce527ea06b342a9b0f7ab4a54f8f0c6` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.365708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce527ea06b342a9b0f7ab4a54f8f0c6)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:44.367910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:44.474227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce527ea06b342a9b0f7ab4a54f8f0c6', 'request_id': 'req-79598cee-50d8-42bf-939d-020a9fcf71fa'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.491742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce527ea06b342a9b0f7ab4a54f8f0c6', 'request_id': 'req-79598cee-50d8-42bf-939d-020a9fcf71fa'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.501747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce527ea06b342a9b0f7ab4a54f8f0c6', 'request_id': 'req-79598cee-50d8-42bf-939d-020a9fcf71fa'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.516285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] The token cache is being invalidate because project 3ce527ea06b342a9b0f7ab4a54f8f0c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:44.516689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.517541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.519304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1023/2045] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:44 2022] DELETE /identity/v3/projects/3ce527ea06b342a9b0f7ab4a54f8f0c6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:44.523394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe4767-5e65-4df2-9906-605d482e71c5 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:44.534104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe4767-5e65-4df2-9906-605d482e71c5 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:44.619982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:44.620726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:44.621060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:44.621353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] PATH_INFO: `/v3/users/ff2a1b045cb84e1095cb06c8b0d78ebf` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:44.622645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2a1b045cb84e1095cb06c8b0d78ebf)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:44.625150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:44.679639 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:44.686432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2a1b045cb84e1095cb06c8b0d78ebf'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.705366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2a1b045cb84e1095cb06c8b0d78ebf'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.712887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2a1b045cb84e1095cb06c8b0d78ebf'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.713703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2a1b045cb84e1095cb06c8b0d78ebf'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.714414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ffb7d118-b603-4f70-af00-117ca4ac500c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2a1b045cb84e1095cb06c8b0d78ebf'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:44.736753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1023/2046] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:44 2022] DELETE /identity/v3/users/ff2a1b045cb84e1095cb06c8b0d78ebf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:45.169348 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.171717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:45.219741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79598cee-50d8-42bf-939d-020a9fcf71fa admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:45.290098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:45.331894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:45.333452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.333878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.334293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] PATH_INFO: `/v3/projects/f8148f61a5b445049bf78544c6b22501` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.336592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8148f61a5b445049bf78544c6b22501)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:45.339293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:45.398043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8148f61a5b445049bf78544c6b22501', 'request_id': 'req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:45.410144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8148f61a5b445049bf78544c6b22501', 'request_id': 'req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:45.419113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8148f61a5b445049bf78544c6b22501', 'request_id': 'req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:45.448388 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] The token cache is being invalidate because project f8148f61a5b445049bf78544c6b22501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:45.448807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:45.452363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d4c4a25f-890e-4b22-8ffc-29cfadf6c880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:45.454206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1024/2047] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:45 2022] DELETE /identity/v3/projects/f8148f61a5b445049bf78544c6b22501 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:45.459080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215f28-f152-41ff-9b35-0cb9e828a49f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.459562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215f28-f152-41ff-9b35-0cb9e828a49f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.459653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215f28-f152-41ff-9b35-0cb9e828a49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.496086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a4215f28-f152-41ff-9b35-0cb9e828a49f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:45.497803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a4215f28-f152-41ff-9b35-0cb9e828a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:45.693106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1024/2048] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:45.698132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdc47a-36cc-4993-8929-10aef5a7675f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.698647 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdc47a-36cc-4993-8929-10aef5a7675f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.699257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdc47a-36cc-4993-8929-10aef5a7675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.740443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-37fdc47a-36cc-4993-8929-10aef5a7675f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:45.741694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-37fdc47a-36cc-4993-8929-10aef5a7675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:45.776939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1025/2049] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:45.778425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215f28-f152-41ff-9b35-0cb9e828a49f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.794818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215f28-f152-41ff-9b35-0cb9e828a49f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:45.807325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee9fed-f27f-4ab8-8f3d-e33eb4a922f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:45.808068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee9fed-f27f-4ab8-8f3d-e33eb4a922f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.808451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee9fed-f27f-4ab8-8f3d-e33eb4a922f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.808973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee9fed-f27f-4ab8-8f3d-e33eb4a922f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.810401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee9fed-f27f-4ab8-8f3d-e33eb4a922f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:45.811306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee9fed-f27f-4ab8-8f3d-e33eb4a922f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:45.820250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee9fed-f27f-4ab8-8f3d-e33eb4a922f3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:45.844837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1025/2050] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:36:45.858667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdc47a-36cc-4993-8929-10aef5a7675f None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.872452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdc47a-36cc-4993-8929-10aef5a7675f None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:45.878265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d017f-03cf-4910-89a2-7009e8ad7f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:45.879073 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d017f-03cf-4910-89a2-7009e8ad7f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:45.879610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d017f-03cf-4910-89a2-7009e8ad7f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:45.880394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d017f-03cf-4910-89a2-7009e8ad7f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:45.881594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d017f-03cf-4910-89a2-7009e8ad7f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:45.883815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d017f-03cf-4910-89a2-7009e8ad7f2f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:45.938951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1026/2051] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:45 2022] POST /identity/v3/projects => generated 353 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:45.946951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee9fed-f27f-4ab8-8f3d-e33eb4a922f3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:45.963570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee9fed-f27f-4ab8-8f3d-e33eb4a922f3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.123375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3175b3-572f-4821-b82f-cae5990420e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.124006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3175b3-572f-4821-b82f-cae5990420e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.124358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3175b3-572f-4821-b82f-cae5990420e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.124726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3175b3-572f-4821-b82f-cae5990420e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.125805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3175b3-572f-4821-b82f-cae5990420e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.129839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3175b3-572f-4821-b82f-cae5990420e7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.162283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1026/2052] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:45 2022] POST /identity/v3/users => generated 277 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:46.166854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d017f-03cf-4910-89a2-7009e8ad7f2f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.182729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d017f-03cf-4910-89a2-7009e8ad7f2f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.189994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9215877-3a43-4ccd-b847-c6c69aefd88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.191894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9215877-3a43-4ccd-b847-c6c69aefd88c admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.193655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9215877-3a43-4ccd-b847-c6c69aefd88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.194229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9215877-3a43-4ccd-b847-c6c69aefd88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.195571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9215877-3a43-4ccd-b847-c6c69aefd88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.197714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9215877-3a43-4ccd-b847-c6c69aefd88c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.211062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1027/2053] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:46.218613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3175b3-572f-4821-b82f-cae5990420e7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.236172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3175b3-572f-4821-b82f-cae5990420e7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.243008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cebc2e-2abc-4236-9485-9c3d8d9b007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.244358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cebc2e-2abc-4236-9485-9c3d8d9b007b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.244644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cebc2e-2abc-4236-9485-9c3d8d9b007b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.244917 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cebc2e-2abc-4236-9485-9c3d8d9b007b admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.245638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cebc2e-2abc-4236-9485-9c3d8d9b007b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.247383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cebc2e-2abc-4236-9485-9c3d8d9b007b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.264808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1027/2054] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:46.266731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9215877-3a43-4ccd-b847-c6c69aefd88c admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.283956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9215877-3a43-4ccd-b847-c6c69aefd88c admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.290850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499638d-b5e5-42d9-96bf-e416f7fe7347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.291774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499638d-b5e5-42d9-96bf-e416f7fe7347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.292245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499638d-b5e5-42d9-96bf-e416f7fe7347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.292667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499638d-b5e5-42d9-96bf-e416f7fe7347 admin admin] PATH_INFO: `/v3/projects/0809adb38be640f49344bbb04171ceed/users/a9a6dfc516c84333a2fb393e3f612cf2/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.310425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd803514-7e7d-41ab-8ea2-0eea9820202c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.310425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd803514-7e7d-41ab-8ea2-0eea9820202c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.310425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd803514-7e7d-41ab-8ea2-0eea9820202c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.310425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1028/2055] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:36:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:36:46.313805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b765ef-7fe3-42e5-8dac-cfe54fc04fd4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.314258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b765ef-7fe3-42e5-8dac-cfe54fc04fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.315082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b765ef-7fe3-42e5-8dac-cfe54fc04fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.316117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499638d-b5e5-42d9-96bf-e416f7fe7347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0809adb38be640f49344bbb04171ceed, user_id=a9a6dfc516c84333a2fb393e3f612cf2, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.319403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499638d-b5e5-42d9-96bf-e416f7fe7347 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.338141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f4b765ef-7fe3-42e5-8dac-cfe54fc04fd4 None None] MFA Rules not processed for user `234cbff2a729458a8dad108baaba6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:46.340130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f4b765ef-7fe3-42e5-8dac-cfe54fc04fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.354588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1028/2056] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:46 2022] PUT /identity/v3/projects/0809adb38be640f49344bbb04171ceed/users/a9a6dfc516c84333a2fb393e3f612cf2/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:46.360036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbc634-f405-43da-a52f-39cff3eb1848 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.360426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbc634-f405-43da-a52f-39cff3eb1848 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.360929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbc634-f405-43da-a52f-39cff3eb1848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.396491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:46.402198 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-dcfbc634-f405-43da-a52f-39cff3eb1848 None None] MFA Rules not processed for user `a9a6dfc516c84333a2fb393e3f612cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:46.403729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-dcfbc634-f405-43da-a52f-39cff3eb1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.472817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1029/2057] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:36:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:46.473255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:46.474355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b765ef-7fe3-42e5-8dac-cfe54fc04fd4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.475985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f4b765ef-7fe3-42e5-8dac-cfe54fc04fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.511184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1029/2058] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:46.512226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbc634-f405-43da-a52f-39cff3eb1848 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.513775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-dcfbc634-f405-43da-a52f-39cff3eb1848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.531234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbc634-f405-43da-a52f-39cff3eb1848 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.538190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3849a-e6c0-49fb-8ef5-b53e0220558c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.538931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3849a-e6c0-49fb-8ef5-b53e0220558c service placement] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.539218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3849a-e6c0-49fb-8ef5-b53e0220558c service placement] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.539500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3849a-e6c0-49fb-8ef5-b53e0220558c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.561140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3849a-e6c0-49fb-8ef5-b53e0220558c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.563284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3849a-e6c0-49fb-8ef5-b53e0220558c service placement] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.578567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1030/2059] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:46.579391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3849a-e6c0-49fb-8ef5-b53e0220558c service placement] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.588658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b765ef-7fe3-42e5-8dac-cfe54fc04fd4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.591350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3849a-e6c0-49fb-8ef5-b53e0220558c service placement] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.594179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.594826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.595105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.595472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] PATH_INFO: `/v3/users/402d29e2c7ce47cfbbb8376fbf85a0ac` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.596994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=402d29e2c7ce47cfbbb8376fbf85a0ac)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.599540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.603183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0500-03c7-4910-bb25-31188f9e6fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.603514 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0500-03c7-4910-bb25-31188f9e6fbf admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.603865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0500-03c7-4910-bb25-31188f9e6fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.604398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0500-03c7-4910-bb25-31188f9e6fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.604910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0500-03c7-4910-bb25-31188f9e6fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.606862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0500-03c7-4910-bb25-31188f9e6fbf admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.644235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1031/2060] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:46 2022] POST /identity/v3/projects => generated 357 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:46.645624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0500-03c7-4910-bb25-31188f9e6fbf admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.655408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402d29e2c7ce47cfbbb8376fbf85a0ac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.666031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402d29e2c7ce47cfbbb8376fbf85a0ac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.676408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402d29e2c7ce47cfbbb8376fbf85a0ac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.677219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402d29e2c7ce47cfbbb8376fbf85a0ac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.677962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402d29e2c7ce47cfbbb8376fbf85a0ac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:46.697831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1030/2061] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:46 2022] DELETE /identity/v3/users/402d29e2c7ce47cfbbb8376fbf85a0ac => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:46.730087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0500-03c7-4910-bb25-31188f9e6fbf admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.796700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ccd13-4c2f-49a9-9fa5-92c837db7a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.797360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ccd13-4c2f-49a9-9fa5-92c837db7a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.797650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ccd13-4c2f-49a9-9fa5-92c837db7a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.797926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ccd13-4c2f-49a9-9fa5-92c837db7a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.798592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ccd13-4c2f-49a9-9fa5-92c837db7a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.800569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ccd13-4c2f-49a9-9fa5-92c837db7a27 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.830550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1032/2062] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:46 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:46.834577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.836488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.851833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605715-6278-4ead-80b1-c9609383bc1d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.857773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0a750-6ebd-4572-a02a-ec6d6cd8a404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.858574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0a750-6ebd-4572-a02a-ec6d6cd8a404 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.858946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0a750-6ebd-4572-a02a-ec6d6cd8a404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.859318 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0a750-6ebd-4572-a02a-ec6d6cd8a404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.860182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0a750-6ebd-4572-a02a-ec6d6cd8a404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.862110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0a750-6ebd-4572-a02a-ec6d6cd8a404 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.873376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1031/2063] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:46.877463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ccd13-4c2f-49a9-9fa5-92c837db7a27 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.889551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ccd13-4c2f-49a9-9fa5-92c837db7a27 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.905459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26344ef3-da68-4d7d-ab2b-d3222413bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:46.906175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26344ef3-da68-4d7d-ab2b-d3222413bd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:46.906459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26344ef3-da68-4d7d-ab2b-d3222413bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:46.906731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26344ef3-da68-4d7d-ab2b-d3222413bd47 admin admin] PATH_INFO: `/v3/projects/4edf6f33a55d430ebd531b19e4ab5bfe/users/95fe02fc90aa4ad1a6e5dab6c8425c39/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:46.925742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0a750-6ebd-4572-a02a-ec6d6cd8a404 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.927848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-96a0a750-6ebd-4572-a02a-ec6d6cd8a404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:46.933141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26344ef3-da68-4d7d-ab2b-d3222413bd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edf6f33a55d430ebd531b19e4ab5bfe, user_id=95fe02fc90aa4ad1a6e5dab6c8425c39, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:46.939193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26344ef3-da68-4d7d-ab2b-d3222413bd47 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:46.952225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0a750-6ebd-4572-a02a-ec6d6cd8a404 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:46.958615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1033/2064] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:46 2022] PUT /identity/v3/projects/4edf6f33a55d430ebd531b19e4ab5bfe/users/95fe02fc90aa4ad1a6e5dab6c8425c39/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:46.963749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26344ef3-da68-4d7d-ab2b-d3222413bd47 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:46.996111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:47.014875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:47.043827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26344ef3-da68-4d7d-ab2b-d3222413bd47 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.052255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80735e0-2734-48a8-ac43-42a16c10fcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.052989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80735e0-2734-48a8-ac43-42a16c10fcec admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.053256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80735e0-2734-48a8-ac43-42a16c10fcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.053579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80735e0-2734-48a8-ac43-42a16c10fcec admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.054401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80735e0-2734-48a8-ac43-42a16c10fcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.057174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80735e0-2734-48a8-ac43-42a16c10fcec admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.058041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.058731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.060854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.066085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] PATH_INFO: `/v3/projects/46a6b96eb6214e93b79c7e9c41c3aad0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.066996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a6b96eb6214e93b79c7e9c41c3aad0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.068986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.074247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1034/2065] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:47.079367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80735e0-2734-48a8-ac43-42a16c10fcec admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.096108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80735e0-2734-48a8-ac43-42a16c10fcec admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.105727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fcdbe-b4ec-4546-8660-22a9b3bbc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.106216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fcdbe-b4ec-4546-8660-22a9b3bbc20a admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.106515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fcdbe-b4ec-4546-8660-22a9b3bbc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.106891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fcdbe-b4ec-4546-8660-22a9b3bbc20a admin admin] PATH_INFO: `/v3/projects/4edf6f33a55d430ebd531b19e4ab5bfe/users/95fe02fc90aa4ad1a6e5dab6c8425c39/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.110321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fcdbe-b4ec-4546-8660-22a9b3bbc20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edf6f33a55d430ebd531b19e4ab5bfe, user_id=95fe02fc90aa4ad1a6e5dab6c8425c39, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.113979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fcdbe-b4ec-4546-8660-22a9b3bbc20a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.135143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1035/2066] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:47 2022] PUT /identity/v3/projects/4edf6f33a55d430ebd531b19e4ab5bfe/users/95fe02fc90aa4ad1a6e5dab6c8425c39/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:47.137475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a6b96eb6214e93b79c7e9c41c3aad0', 'request_id': 'req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.145304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030bd33-21ef-4263-939c-7d359791db69 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.145658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030bd33-21ef-4263-939c-7d359791db69 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.145979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030bd33-21ef-4263-939c-7d359791db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.147465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a6b96eb6214e93b79c7e9c41c3aad0', 'request_id': 'req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.157238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a6b96eb6214e93b79c7e9c41c3aad0', 'request_id': 'req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.178843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] The token cache is being invalidate because project 46a6b96eb6214e93b79c7e9c41c3aad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:47.179399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.180126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e96512d0-5f5c-41a5-9cc8-85f258eeeba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.182562 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1032/2067] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:46 2022] DELETE /identity/v3/projects/46a6b96eb6214e93b79c7e9c41c3aad0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:47.188218 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d790f3b-923c-4da1-b518-a7b3d543d3ac None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.188947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d790f3b-923c-4da1-b518-a7b3d543d3ac None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.194860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d790f3b-923c-4da1-b518-a7b3d543d3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.200586 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3030bd33-21ef-4263-939c-7d359791db69 None None] MFA Rules not processed for user `95fe02fc90aa4ad1a6e5dab6c8425c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:47.201978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3030bd33-21ef-4263-939c-7d359791db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.234469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1d790f3b-923c-4da1-b518-a7b3d543d3ac None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:47.236428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1d790f3b-923c-4da1-b518-a7b3d543d3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.330049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1036/2068] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:47.331715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030bd33-21ef-4263-939c-7d359791db69 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.331958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1033/2069] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:47.333252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3030bd33-21ef-4263-939c-7d359791db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.333771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0be9-a806-45f2-a8b6-b27ac25b753e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.334055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0be9-a806-45f2-a8b6-b27ac25b753e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.334327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0be9-a806-45f2-a8b6-b27ac25b753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.354026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030bd33-21ef-4263-939c-7d359791db69 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.360234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.360855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8c5c0be9-a806-45f2-a8b6-b27ac25b753e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:47.360943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.361149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.361487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8c5c0be9-a806-45f2-a8b6-b27ac25b753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.361853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] PATH_INFO: `/v3/users/d3572eab9cd04e51bcbc9efbde734102` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.363864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3572eab9cd04e51bcbc9efbde734102)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.366124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.372362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1034/2070] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:47.373250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0be9-a806-45f2-a8b6-b27ac25b753e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.374941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8c5c0be9-a806-45f2-a8b6-b27ac25b753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.439512 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3572eab9cd04e51bcbc9efbde734102'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.450092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3572eab9cd04e51bcbc9efbde734102'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.452937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0be9-a806-45f2-a8b6-b27ac25b753e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.461298 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3f60f-7b54-41a8-926e-b85a2df8eaa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.462671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f60f-7b54-41a8-926e-b85a2df8eaa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.463337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f60f-7b54-41a8-926e-b85a2df8eaa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.463615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f60f-7b54-41a8-926e-b85a2df8eaa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.468406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3572eab9cd04e51bcbc9efbde734102'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.469093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3572eab9cd04e51bcbc9efbde734102'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.479235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3f60f-7b54-41a8-926e-b85a2df8eaa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.481158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3f60f-7b54-41a8-926e-b85a2df8eaa9 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.485583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:47.494916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3572eab9cd04e51bcbc9efbde734102'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.503314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1037/2071] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:47 2022] DELETE /identity/v3/users/d3572eab9cd04e51bcbc9efbde734102 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:47.507226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.508669 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.509738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1035/2072] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:47.511200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9c7fa-fa44-4e67-9fad-a2dfecb623e6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.511487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9c7fa-fa44-4e67-9fad-a2dfecb623e6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.512563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9c7fa-fa44-4e67-9fad-a2dfecb623e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.515835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:47.581569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8fb9c7fa-fa44-4e67-9fad-a2dfecb623e6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:47.582773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8fb9c7fa-fa44-4e67-9fad-a2dfecb623e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.642218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770062c-a6a8-40f1-ab8a-36120dda0f85 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.650340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.651333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.651674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.652399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.653238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:47.653631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.655288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.667988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1038/2073] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:47.668761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.671942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1036/2074] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:47.675003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.675085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9c7fa-fa44-4e67-9fad-a2dfecb623e6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.676330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8fb9c7fa-fa44-4e67-9fad-a2dfecb623e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.696912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef3ea-1fd3-4e08-a947-ac3ebe11c81e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.710377 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.711026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.711696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.712538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] PATH_INFO: `/v3/users/5b202a5fd27247ea98b1c52b0c90698f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.713846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b202a5fd27247ea98b1c52b0c90698f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.715784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.751634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9c7fa-fa44-4e67-9fad-a2dfecb623e6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.757418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.758387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.759475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.759942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.763278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.771885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b202a5fd27247ea98b1c52b0c90698f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.780745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b202a5fd27247ea98b1c52b0c90698f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.789397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b202a5fd27247ea98b1c52b0c90698f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.790153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b202a5fd27247ea98b1c52b0c90698f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.804723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b202a5fd27247ea98b1c52b0c90698f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:47.811520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1039/2075] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:47 2022] DELETE /identity/v3/users/5b202a5fd27247ea98b1c52b0c90698f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:47.812136 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.813535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.842135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.844297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.855401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1037/2076] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:47.856222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:47.857605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:47.900038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9a6dd-7338-433c-b227-8706d1e93177 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.907534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a04767-5856-43bb-a3fa-b3c45f761cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:47.908340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04767-5856-43bb-a3fa-b3c45f761cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.908919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04767-5856-43bb-a3fa-b3c45f761cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.909210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04767-5856-43bb-a3fa-b3c45f761cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.910123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a04767-5856-43bb-a3fa-b3c45f761cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:47.912839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a04767-5856-43bb-a3fa-b3c45f761cfb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:47.935952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:47.950501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb918c93-019c-4457-822d-661d0ace81d5 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:47.956387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1040/2077] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:47 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:47.957502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975adf46-6fb1-43dd-9875-e00cc555ecbf None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:47.957779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975adf46-6fb1-43dd-9875-e00cc555ecbf None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:47.958331 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975adf46-6fb1-43dd-9875-e00cc555ecbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:47.959030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:47.992499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-975adf46-6fb1-43dd-9875-e00cc555ecbf None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:47.995584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-975adf46-6fb1-43dd-9875-e00cc555ecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.030462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b033c4-db50-4250-b602-b11f71cc20c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.031210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b033c4-db50-4250-b602-b11f71cc20c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.031596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b033c4-db50-4250-b602-b11f71cc20c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.031929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b033c4-db50-4250-b602-b11f71cc20c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.034122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-23b033c4-db50-4250-b602-b11f71cc20c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.049048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b033c4-db50-4250-b602-b11f71cc20c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.050655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b033c4-db50-4250-b602-b11f71cc20c2 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.062194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1038/2078] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:48.066446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b033c4-db50-4250-b602-b11f71cc20c2 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.075281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1041/2079] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:48.077478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b033c4-db50-4250-b602-b11f71cc20c2 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.083209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520369-56ab-4115-bffc-47af1b3ab4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.083828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520369-56ab-4115-bffc-47af1b3ab4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.084106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520369-56ab-4115-bffc-47af1b3ab4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.084376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520369-56ab-4115-bffc-47af1b3ab4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.085038 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520369-56ab-4115-bffc-47af1b3ab4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.087013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975adf46-6fb1-43dd-9875-e00cc555ecbf None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.087161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520369-56ab-4115-bffc-47af1b3ab4a7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.088465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-975adf46-6fb1-43dd-9875-e00cc555ecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.115276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1039/2080] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:48 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:48.120015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520369-56ab-4115-bffc-47af1b3ab4a7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.134634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520369-56ab-4115-bffc-47af1b3ab4a7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.140049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a8ee-4221-45fd-823a-d2af54813a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.140668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a8ee-4221-45fd-823a-d2af54813a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.140973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a8ee-4221-45fd-823a-d2af54813a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.141250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a8ee-4221-45fd-823a-d2af54813a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.142087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2a8ee-4221-45fd-823a-d2af54813a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.143931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2a8ee-4221-45fd-823a-d2af54813a60 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.158037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1040/2081] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:48.161816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a8ee-4221-45fd-823a-d2af54813a60 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.166259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975adf46-6fb1-43dd-9875-e00cc555ecbf None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.170133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd4907-8f69-4f12-af59-bb87d23c0f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.170820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4907-8f69-4f12-af59-bb87d23c0f8c service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.171157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4907-8f69-4f12-af59-bb87d23c0f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.171368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4907-8f69-4f12-af59-bb87d23c0f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.174223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a8ee-4221-45fd-823a-d2af54813a60 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.182265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ea476-8216-4011-825a-68a7c1dc85c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.182762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd4907-8f69-4f12-af59-bb87d23c0f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.183027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ea476-8216-4011-825a-68a7c1dc85c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.183312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ea476-8216-4011-825a-68a7c1dc85c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.183907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ea476-8216-4011-825a-68a7c1dc85c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.184317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd4907-8f69-4f12-af59-bb87d23c0f8c service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.184603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ea476-8216-4011-825a-68a7c1dc85c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.186350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ea476-8216-4011-825a-68a7c1dc85c2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.200371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1041/2082] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:48.204100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1042/2083] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:48.204512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ea476-8216-4011-825a-68a7c1dc85c2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.219976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ea476-8216-4011-825a-68a7c1dc85c2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.230667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaee91-2791-4f5f-918c-2d566697f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.231736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaee91-2791-4f5f-918c-2d566697f3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.232581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaee91-2791-4f5f-918c-2d566697f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.233141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaee91-2791-4f5f-918c-2d566697f3fa admin admin] PATH_INFO: `/v3/projects/c76d1fe69b2e4c5dbb1493fce4c8b2ca/users/bb8f655ed67d46a5b4211a851f8da02d/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.257962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaee91-2791-4f5f-918c-2d566697f3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76d1fe69b2e4c5dbb1493fce4c8b2ca, user_id=bb8f655ed67d46a5b4211a851f8da02d, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.261262 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaee91-2791-4f5f-918c-2d566697f3fa admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.281867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1042/2084] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:48 2022] PUT /identity/v3/projects/c76d1fe69b2e4c5dbb1493fce4c8b2ca/users/bb8f655ed67d46a5b4211a851f8da02d/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:48.286852 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34641-decc-4bbb-8f85-b1666b43327e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.287474 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34641-decc-4bbb-8f85-b1666b43327e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.287890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34641-decc-4bbb-8f85-b1666b43327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.309638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-93e34641-decc-4bbb-8f85-b1666b43327e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:48.310860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-93e34641-decc-4bbb-8f85-b1666b43327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.380191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaee91-2791-4f5f-918c-2d566697f3fa admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.382244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cffaee91-2791-4f5f-918c-2d566697f3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.398014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1043/2085] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:48.401638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaee91-2791-4f5f-918c-2d566697f3fa admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.403807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.404455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.404863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.405155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] PATH_INFO: `/v3/projects/9a0d2d5c81a44c658be17d51746aec11` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.407100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0d2d5c81a44c658be17d51746aec11)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.409102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.415685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34641-decc-4bbb-8f85-b1666b43327e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.463432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0d2d5c81a44c658be17d51746aec11', 'request_id': 'req-9e225fe8-ef93-46d2-9cae-e4ba871910f6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.468372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:48.472451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0d2d5c81a44c658be17d51746aec11', 'request_id': 'req-9e225fe8-ef93-46d2-9cae-e4ba871910f6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.480579 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0d2d5c81a44c658be17d51746aec11', 'request_id': 'req-9e225fe8-ef93-46d2-9cae-e4ba871910f6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.490427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34641-decc-4bbb-8f85-b1666b43327e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.498080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] The token cache is being invalidate because project 9a0d2d5c81a44c658be17d51746aec11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:48.498455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.499245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.501013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1043/2086] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:48 2022] DELETE /identity/v3/projects/9a0d2d5c81a44c658be17d51746aec11 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:48.504783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.507881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.544687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:48.552476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.553092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.553402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.553682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.555478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.581600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e225fe8-ef93-46d2-9cae-e4ba871910f6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.586467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.587280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.587565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.587960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] PATH_INFO: `/v3/users/a02ac967750f43cc9ef5eee00abba115` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.589473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a02ac967750f43cc9ef5eee00abba115)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.591819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.635885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.637464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.647781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a02ac967750f43cc9ef5eee00abba115'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.649255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1044/2087] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:48.650655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.651941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.659522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a02ac967750f43cc9ef5eee00abba115'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.666504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd6ddb-1045-4e49-a11e-651c2c910534 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.671904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a02ac967750f43cc9ef5eee00abba115'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.672069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.672767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.672873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a02ac967750f43cc9ef5eee00abba115'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.673123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.673432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] PATH_INFO: `/v3/projects/34aa7542beb8410a8d125b176339e859` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.673692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ea6bac54-925e-4f55-9262-97e62f719c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a02ac967750f43cc9ef5eee00abba115'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.674846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34aa7542beb8410a8d125b176339e859)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.676914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.705012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1044/2088] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:48 2022] DELETE /identity/v3/users/a02ac967750f43cc9ef5eee00abba115 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:48.758061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34aa7542beb8410a8d125b176339e859', 'request_id': 'req-fdfe3376-a323-48cc-944d-1b32f68b8019'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.768340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34aa7542beb8410a8d125b176339e859', 'request_id': 'req-fdfe3376-a323-48cc-944d-1b32f68b8019'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.775760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34aa7542beb8410a8d125b176339e859', 'request_id': 'req-fdfe3376-a323-48cc-944d-1b32f68b8019'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.789778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] The token cache is being invalidate because project 34aa7542beb8410a8d125b176339e859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:48.790085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.792487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fdfe3376-a323-48cc-944d-1b32f68b8019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:48.794271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1045/2089] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:48 2022] DELETE /identity/v3/projects/34aa7542beb8410a8d125b176339e859 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:48.799606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda30c75-267c-4470-8565-00d1ae27f2dd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.799961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda30c75-267c-4470-8565-00d1ae27f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.800363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda30c75-267c-4470-8565-00d1ae27f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.825679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cda30c75-267c-4470-8565-00d1ae27f2dd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:48.830042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cda30c75-267c-4470-8565-00d1ae27f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.907555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1045/2090] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:48.918843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1364a-0536-4e3c-bda1-05a0030fccc7 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.919217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1364a-0536-4e3c-bda1-05a0030fccc7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.919501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1364a-0536-4e3c-bda1-05a0030fccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.942727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-60f1364a-0536-4e3c-bda1-05a0030fccc7 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:48.943976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-60f1364a-0536-4e3c-bda1-05a0030fccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:48.952848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1046/2091] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:48.957455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda30c75-267c-4470-8565-00d1ae27f2dd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:48.968378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda30c75-267c-4470-8565-00d1ae27f2dd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:48.974307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21bfb4-5b26-4a05-8059-9709ed5fbf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:48.974633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21bfb4-5b26-4a05-8059-9709ed5fbf36 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:48.975055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21bfb4-5b26-4a05-8059-9709ed5fbf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:48.975279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21bfb4-5b26-4a05-8059-9709ed5fbf36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:48.976316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21bfb4-5b26-4a05-8059-9709ed5fbf36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:48.976625 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21bfb4-5b26-4a05-8059-9709ed5fbf36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:48.979157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21bfb4-5b26-4a05-8059-9709ed5fbf36 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:48.991751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1046/2092] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:36:48.999838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1364a-0536-4e3c-bda1-05a0030fccc7 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.023712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1364a-0536-4e3c-bda1-05a0030fccc7 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.035049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03a2ad-737d-4b64-acb1-3672ad00657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.048540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03a2ad-737d-4b64-acb1-3672ad00657d admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.048540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03a2ad-737d-4b64-acb1-3672ad00657d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.048540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03a2ad-737d-4b64-acb1-3672ad00657d admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.049888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03a2ad-737d-4b64-acb1-3672ad00657d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.051826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03a2ad-737d-4b64-acb1-3672ad00657d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.110584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:49.122511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1047/2093] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:48 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:49.124998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21bfb4-5b26-4a05-8059-9709ed5fbf36 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.138989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21bfb4-5b26-4a05-8059-9709ed5fbf36 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.221004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:49.231698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03a2ad-737d-4b64-acb1-3672ad00657d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.235334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0d03a2ad-737d-4b64-acb1-3672ad00657d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.287469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cecf65b-0dbe-4d89-a206-ca4b1eb48efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.289023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecf65b-0dbe-4d89-a206-ca4b1eb48efe admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.289145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecf65b-0dbe-4d89-a206-ca4b1eb48efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.289401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecf65b-0dbe-4d89-a206-ca4b1eb48efe admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.290149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecf65b-0dbe-4d89-a206-ca4b1eb48efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.297352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecf65b-0dbe-4d89-a206-ca4b1eb48efe admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.332368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1047/2094] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:49 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:49.333665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cecf65b-0dbe-4d89-a206-ca4b1eb48efe admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.336064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3cecf65b-0dbe-4d89-a206-ca4b1eb48efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.367040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cecf65b-0dbe-4d89-a206-ca4b1eb48efe admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.376623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.377636 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.378014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.378495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] PATH_INFO: `/v3/users/d8f806e5539d42c5b987f0d68481ea0a` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.379654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03a2ad-737d-4b64-acb1-3672ad00657d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.380080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f806e5539d42c5b987f0d68481ea0a)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.382473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.386966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.388573 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.388964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.389414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] PATH_INFO: `/v3/projects/b695986638844f3dac4c85b5619986cc` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.396206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b695986638844f3dac4c85b5619986cc)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.398691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.454810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b695986638844f3dac4c85b5619986cc', 'request_id': 'req-b413a6dc-5610-4c57-95c3-57321d17ee17'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.458103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f806e5539d42c5b987f0d68481ea0a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.466799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b695986638844f3dac4c85b5619986cc', 'request_id': 'req-b413a6dc-5610-4c57-95c3-57321d17ee17'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.471037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f806e5539d42c5b987f0d68481ea0a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.474107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b695986638844f3dac4c85b5619986cc', 'request_id': 'req-b413a6dc-5610-4c57-95c3-57321d17ee17'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.481681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f806e5539d42c5b987f0d68481ea0a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.483642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f806e5539d42c5b987f0d68481ea0a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.484706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f806e5539d42c5b987f0d68481ea0a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.487192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] The token cache is being invalidate because project b695986638844f3dac4c85b5619986cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:49.487493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.488746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.490933 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1048/2095] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:49 2022] DELETE /identity/v3/projects/b695986638844f3dac4c85b5619986cc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:49.491806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.494342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.505619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1048/2096] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:49 2022] DELETE /identity/v3/users/d8f806e5539d42c5b987f0d68481ea0a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:49.506516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.507828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.593881 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a6dc-5610-4c57-95c3-57321d17ee17 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.604083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e81af-e2ef-4e2a-b91e-1e0361fa3a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.605688 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e81af-e2ef-4e2a-b91e-1e0361fa3a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.605979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e81af-e2ef-4e2a-b91e-1e0361fa3a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.606277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e81af-e2ef-4e2a-b91e-1e0361fa3a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.607156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d79a4b-d5ec-4eb4-908c-6289097dbe5c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.607900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e81af-e2ef-4e2a-b91e-1e0361fa3a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.609745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e81af-e2ef-4e2a-b91e-1e0361fa3a13 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.615221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.616081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.617164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.617740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] PATH_INFO: `/v3/users/2c9d0c347b7e42fe824995edec08acfe` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.620344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9d0c347b7e42fe824995edec08acfe)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.622634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.627343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1049/2097] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:49.629035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543b61-f90e-4db2-94b6-d449ef5b3c2a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.629352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543b61-f90e-4db2-94b6-d449ef5b3c2a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.629624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543b61-f90e-4db2-94b6-d449ef5b3c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.653490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-38543b61-f90e-4db2-94b6-d449ef5b3c2a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:49.654668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-38543b61-f90e-4db2-94b6-d449ef5b3c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.669927 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1050/2098] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:49.670944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38543b61-f90e-4db2-94b6-d449ef5b3c2a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.682757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38543b61-f90e-4db2-94b6-d449ef5b3c2a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.689237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2485a-fbac-4375-bb24-f6c546b528d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.689497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2485a-fbac-4375-bb24-f6c546b528d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.689730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2485a-fbac-4375-bb24-f6c546b528d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.689958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2485a-fbac-4375-bb24-f6c546b528d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.690707 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2485a-fbac-4375-bb24-f6c546b528d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.692361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2485a-fbac-4375-bb24-f6c546b528d2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.707651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1051/2099] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:49.707651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2485a-fbac-4375-bb24-f6c546b528d2 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.707651 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-afa2485a-fbac-4375-bb24-f6c546b528d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.709790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=80,keystone:INSERT=4,keystone:DELETE=16 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:49.718498 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9d0c347b7e42fe824995edec08acfe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.722529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:49.733535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9d0c347b7e42fe824995edec08acfe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.742561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9d0c347b7e42fe824995edec08acfe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.744126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9d0c347b7e42fe824995edec08acfe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.744743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9d0c347b7e42fe824995edec08acfe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:49.767883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1049/2100] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:49 2022] DELETE /identity/v3/users/2c9d0c347b7e42fe824995edec08acfe => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:49.768746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.770494 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.801839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2485a-fbac-4375-bb24-f6c546b528d2 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.924460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c040d80-7f4a-40c6-b3d5-329ec1dc470f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:49.935242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544d321-5297-44a6-9896-97fd8875b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.935936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544d321-5297-44a6-9896-97fd8875b143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.936353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544d321-5297-44a6-9896-97fd8875b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.936638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544d321-5297-44a6-9896-97fd8875b143 admin admin] PATH_INFO: `/v3/projects/78f6f76353b847c995eca71c9d6418f0/users/1553810df7084cfa9451f2582043a423/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.937779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099845e-032f-4681-a1af-ea9b04818f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:49.939354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099845e-032f-4681-a1af-ea9b04818f31 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:49.939740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099845e-032f-4681-a1af-ea9b04818f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:49.940118 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099845e-032f-4681-a1af-ea9b04818f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:49.944865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a099845e-032f-4681-a1af-ea9b04818f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:49.958667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544d321-5297-44a6-9896-97fd8875b143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f6f76353b847c995eca71c9d6418f0, user_id=1553810df7084cfa9451f2582043a423, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.962601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544d321-5297-44a6-9896-97fd8875b143 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.978417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099845e-032f-4681-a1af-ea9b04818f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:49.981714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099845e-032f-4681-a1af-ea9b04818f31 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:49.990015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1050/2101] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:49 2022] PUT /identity/v3/projects/78f6f76353b847c995eca71c9d6418f0/users/1553810df7084cfa9451f2582043a423/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:49.990015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544d321-5297-44a6-9896-97fd8875b143 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:49.992771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7544d321-5297-44a6-9896-97fd8875b143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.010279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1052/2102] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:50.011943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90706d-d7d0-4371-9d33-3f25f5cf1011 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.013018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90706d-d7d0-4371-9d33-3f25f5cf1011 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.013474 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90706d-d7d0-4371-9d33-3f25f5cf1011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.068662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-df90706d-d7d0-4371-9d33-3f25f5cf1011 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:50.069832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-df90706d-d7d0-4371-9d33-3f25f5cf1011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.076724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544d321-5297-44a6-9896-97fd8875b143 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:50.078110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1053/2103] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:50.085854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:50.086948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.087212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.087473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] PATH_INFO: `/v3/users/1d9920e2d1de4560b0c103dc2b9c8ca4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.088731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9920e2d1de4560b0c103dc2b9c8ca4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:50.090752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:50.148629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:50.152916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9920e2d1de4560b0c103dc2b9c8ca4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.165922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90706d-d7d0-4371-9d33-3f25f5cf1011 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:50.167043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9920e2d1de4560b0c103dc2b9c8ca4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.167659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-df90706d-d7d0-4371-9d33-3f25f5cf1011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.176908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9920e2d1de4560b0c103dc2b9c8ca4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.178662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9920e2d1de4560b0c103dc2b9c8ca4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.180369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326bb2e-5122-427e-9be6-e444a9959d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9920e2d1de4560b0c103dc2b9c8ca4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.205819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1051/2104] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:49 2022] DELETE /identity/v3/users/1d9920e2d1de4560b0c103dc2b9c8ca4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:50.210286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06a40d-368d-416e-9901-a32fdae696ec None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.210739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06a40d-368d-416e-9901-a32fdae696ec None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.211108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06a40d-368d-416e-9901-a32fdae696ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.240526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cc06a40d-368d-416e-9901-a32fdae696ec None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:50.242079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cc06a40d-368d-416e-9901-a32fdae696ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.287513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90706d-d7d0-4371-9d33-3f25f5cf1011 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:50.350407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1052/2105] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:50.374844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:50.375512 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.375795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.376074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.378460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.394363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:50.396035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:50.407301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06a40d-368d-416e-9901-a32fdae696ec None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:50.409478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cc06a40d-368d-416e-9901-a32fdae696ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.412030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1054/2106] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:50.434158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06a40d-368d-416e-9901-a32fdae696ec None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:50.453023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67cc28-f0dc-4564-a304-a1b8e83e4792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:50.453686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67cc28-f0dc-4564-a304-a1b8e83e4792 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.453972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67cc28-f0dc-4564-a304-a1b8e83e4792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.458559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67cc28-f0dc-4564-a304-a1b8e83e4792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.479368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67cc28-f0dc-4564-a304-a1b8e83e4792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:50.482223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67cc28-f0dc-4564-a304-a1b8e83e4792 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:50.504541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:50.506475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.510240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1053/2107] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:50.530669 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9caeb-c176-439f-b1df-7a45e0e1b516 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:50.542875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:50.546372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.547031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.547459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] PATH_INFO: `/v3/projects/92f4d2a28cbf43f482ed22d34507f99d` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.551919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f4d2a28cbf43f482ed22d34507f99d)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:50.555747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:50.586653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:50.663130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f4d2a28cbf43f482ed22d34507f99d', 'request_id': 'req-e12c6705-eed1-4c19-928a-40ade5afead6'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.679328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f4d2a28cbf43f482ed22d34507f99d', 'request_id': 'req-e12c6705-eed1-4c19-928a-40ade5afead6'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.692438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f4d2a28cbf43f482ed22d34507f99d', 'request_id': 'req-e12c6705-eed1-4c19-928a-40ade5afead6'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.713555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] The token cache is being invalidate because project 92f4d2a28cbf43f482ed22d34507f99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:50.713867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.714522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e12c6705-eed1-4c19-928a-40ade5afead6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:50.717549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1055/2108] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:50 2022] DELETE /identity/v3/projects/92f4d2a28cbf43f482ed22d34507f99d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:50.722687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e884bb-2d67-4e09-968b-5f015e338b16 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.722975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e884bb-2d67-4e09-968b-5f015e338b16 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.723250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e884bb-2d67-4e09-968b-5f015e338b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:50.751439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-09e884bb-2d67-4e09-968b-5f015e338b16 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:50.754898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-09e884bb-2d67-4e09-968b-5f015e338b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:50.904201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1054/2109] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:50.915173 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057b204-882b-46b9-a9c9-e2646e85c027 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:50.916317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057b204-882b-46b9-a9c9-e2646e85c027 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:50.916888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057b204-882b-46b9-a9c9-e2646e85c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.018216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e057b204-882b-46b9-a9c9-e2646e85c027 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:51.019457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e057b204-882b-46b9-a9c9-e2646e85c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:51.044919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1056/2110] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:51.050078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e884bb-2d67-4e09-968b-5f015e338b16 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.066367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e884bb-2d67-4e09-968b-5f015e338b16 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.080174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34e7b2-714e-4361-8f5f-4db9d18fe507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.080876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34e7b2-714e-4361-8f5f-4db9d18fe507 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.081162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34e7b2-714e-4361-8f5f-4db9d18fe507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.081468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34e7b2-714e-4361-8f5f-4db9d18fe507 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.082245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34e7b2-714e-4361-8f5f-4db9d18fe507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:51.082554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34e7b2-714e-4361-8f5f-4db9d18fe507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.087603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34e7b2-714e-4361-8f5f-4db9d18fe507 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.128533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1055/2111] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:51.133230 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057b204-882b-46b9-a9c9-e2646e85c027 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.148945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057b204-882b-46b9-a9c9-e2646e85c027 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.164157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9b643-2e62-4efb-8374-2ac0f5271f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.164838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9b643-2e62-4efb-8374-2ac0f5271f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.165391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9b643-2e62-4efb-8374-2ac0f5271f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.165391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9b643-2e62-4efb-8374-2ac0f5271f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.166089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9b643-2e62-4efb-8374-2ac0f5271f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.168756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9b643-2e62-4efb-8374-2ac0f5271f5f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.205648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1057/2112] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:51 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:51.206733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34e7b2-714e-4361-8f5f-4db9d18fe507 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.219189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34e7b2-714e-4361-8f5f-4db9d18fe507 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.259803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9b643-2e62-4efb-8374-2ac0f5271f5f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.260474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:51.263842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c5d9b643-2e62-4efb-8374-2ac0f5271f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:51.342721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a943a-ee79-4235-a731-48df718eb386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.345407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a943a-ee79-4235-a731-48df718eb386 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.345915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a943a-ee79-4235-a731-48df718eb386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.347194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a943a-ee79-4235-a731-48df718eb386 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.348987 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a943a-ee79-4235-a731-48df718eb386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.357450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a943a-ee79-4235-a731-48df718eb386 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.396415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1056/2113] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:51 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:51.405176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a943a-ee79-4235-a731-48df718eb386 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.407142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9b643-2e62-4efb-8374-2ac0f5271f5f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.412730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.414515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.415741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.416228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] PATH_INFO: `/v3/projects/b217aa95460b43d4bd9aa4e8ccd48414` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.417863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b217aa95460b43d4bd9aa4e8ccd48414)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.420655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.432285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a943a-ee79-4235-a731-48df718eb386 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.440642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc537e2-6ba2-46fa-96f2-4cc0a91e9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.441572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc537e2-6ba2-46fa-96f2-4cc0a91e9ade admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.442209 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc537e2-6ba2-46fa-96f2-4cc0a91e9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.442695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc537e2-6ba2-46fa-96f2-4cc0a91e9ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.443710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc537e2-6ba2-46fa-96f2-4cc0a91e9ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.445887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc537e2-6ba2-46fa-96f2-4cc0a91e9ade admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.459755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1057/2114] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:51.461308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc537e2-6ba2-46fa-96f2-4cc0a91e9ade admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.465386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1dc537e2-6ba2-46fa-96f2-4cc0a91e9ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:51.487936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc537e2-6ba2-46fa-96f2-4cc0a91e9ade admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.506835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.507689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.508082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.508970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] PATH_INFO: `/v3/projects/f4d54cc5f10d4da6b23ef4add8e2e63d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.510356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d54cc5f10d4da6b23ef4add8e2e63d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.512490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.518154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b217aa95460b43d4bd9aa4e8ccd48414', 'request_id': 'req-9a099788-8466-4136-99a1-2fdd316757c0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.534412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b217aa95460b43d4bd9aa4e8ccd48414', 'request_id': 'req-9a099788-8466-4136-99a1-2fdd316757c0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.546809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b217aa95460b43d4bd9aa4e8ccd48414', 'request_id': 'req-9a099788-8466-4136-99a1-2fdd316757c0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.577072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] The token cache is being invalidate because project b217aa95460b43d4bd9aa4e8ccd48414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:51.577816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.578366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.584452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1058/2115] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:51 2022] DELETE /identity/v3/projects/b217aa95460b43d4bd9aa4e8ccd48414 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:51.585711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.587539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:51.593025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:51.597507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d54cc5f10d4da6b23ef4add8e2e63d', 'request_id': 'req-424e6565-51bf-44b0-b136-400234cc907e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.609828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d54cc5f10d4da6b23ef4add8e2e63d', 'request_id': 'req-424e6565-51bf-44b0-b136-400234cc907e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.626798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d54cc5f10d4da6b23ef4add8e2e63d', 'request_id': 'req-424e6565-51bf-44b0-b136-400234cc907e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.660427 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] The token cache is being invalidate because project f4d54cc5f10d4da6b23ef4add8e2e63d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:51.661029 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.662727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.667071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1058/2116] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:51 2022] DELETE /identity/v3/projects/f4d54cc5f10d4da6b23ef4add8e2e63d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:51.668468 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.672400 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:51.759784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a099788-8466-4136-99a1-2fdd316757c0 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.848905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6565-51bf-44b0-b136-400234cc907e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.856692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.857739 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.858088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.858534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] PATH_INFO: `/v3/users/562ff5091fcd4a84bc434ca45262bf84` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.860970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562ff5091fcd4a84bc434ca45262bf84)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.863949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.886615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa4e3-e144-4a5b-9bbe-9f7e1f50d99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.887261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa4e3-e144-4a5b-9bbe-9f7e1f50d99f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.887540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa4e3-e144-4a5b-9bbe-9f7e1f50d99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.887818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa4e3-e144-4a5b-9bbe-9f7e1f50d99f admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.889142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fa4e3-e144-4a5b-9bbe-9f7e1f50d99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.890820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fa4e3-e144-4a5b-9bbe-9f7e1f50d99f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.909750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1059/2117] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:51.911762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa4e3-e144-4a5b-9bbe-9f7e1f50d99f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:51.915996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f67fa4e3-e144-4a5b-9bbe-9f7e1f50d99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:51.938810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa4e3-e144-4a5b-9bbe-9f7e1f50d99f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:51.941002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:51.944703 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:51.945431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:51.945782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:51.946375 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] PATH_INFO: `/v3/users/73cbd30ba8784534805e5e2e1cd00358` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:51.947906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73cbd30ba8784534805e5e2e1cd00358)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:51.950018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:51.952364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562ff5091fcd4a84bc434ca45262bf84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.961591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562ff5091fcd4a84bc434ca45262bf84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.979694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562ff5091fcd4a84bc434ca45262bf84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.980945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562ff5091fcd4a84bc434ca45262bf84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:51.981678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562ff5091fcd4a84bc434ca45262bf84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.014826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73cbd30ba8784534805e5e2e1cd00358'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.021488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1059/2118] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:51 2022] DELETE /identity/v3/users/562ff5091fcd4a84bc434ca45262bf84 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:52.023869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:52.027635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73cbd30ba8784534805e5e2e1cd00358'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.030565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:52.041823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73cbd30ba8784534805e5e2e1cd00358'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.043094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73cbd30ba8784534805e5e2e1cd00358'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.074934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a0b689c-efb9-453f-8937-1ab48b657043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73cbd30ba8784534805e5e2e1cd00358'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.090782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1060/2119] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:51 2022] DELETE /identity/v3/users/73cbd30ba8784534805e5e2e1cd00358 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:52.182926 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e68943-58d9-4781-874a-34e0de4c2247 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:52.365231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0514a-c343-4876-afd5-281c587c8dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:52.366173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0514a-c343-4876-afd5-281c587c8dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.366806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0514a-c343-4876-afd5-281c587c8dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.369745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0514a-c343-4876-afd5-281c587c8dcc admin admin] PATH_INFO: `/v3/projects/5a4e83d95bd84120b64f40d815de0e55/users/0cb8dd0681aa425fa32475d6d7f34871/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.425077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0514a-c343-4876-afd5-281c587c8dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4e83d95bd84120b64f40d815de0e55, user_id=0cb8dd0681aa425fa32475d6d7f34871, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:52.433631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0514a-c343-4876-afd5-281c587c8dcc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:52.467224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1060/2120] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:52 2022] PUT /identity/v3/projects/5a4e83d95bd84120b64f40d815de0e55/users/0cb8dd0681aa425fa32475d6d7f34871/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:52.478294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3445b-64db-40c4-8085-58fee4f1b183 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.478822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3445b-64db-40c4-8085-58fee4f1b183 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.478822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3445b-64db-40c4-8085-58fee4f1b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.500755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0514a-c343-4876-afd5-281c587c8dcc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:52.503143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7bb0514a-c343-4876-afd5-281c587c8dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:52.548571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-c7b3445b-64db-40c4-8085-58fee4f1b183 None None] MFA Rules not processed for user `0cb8dd0681aa425fa32475d6d7f34871`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:52.549995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c7b3445b-64db-40c4-8085-58fee4f1b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:52.561869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:52.630356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:52.686001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0514a-c343-4876-afd5-281c587c8dcc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:52.699433 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:52.700217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.700715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.701290 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] PATH_INFO: `/v3/projects/9eac64f25b184a0caad4c61edcb0700a` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.704225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eac64f25b184a0caad4c61edcb0700a)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:52.706534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:52.731798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1061/2121] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:52.739561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3445b-64db-40c4-8085-58fee4f1b183 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:52.741102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c7b3445b-64db-40c4-8085-58fee4f1b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:52.846942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3445b-64db-40c4-8085-58fee4f1b183 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:52.871277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eac64f25b184a0caad4c61edcb0700a', 'request_id': 'req-8b1eac69-315d-42f5-8ee7-eef065bbfc13'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.887946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eac64f25b184a0caad4c61edcb0700a', 'request_id': 'req-8b1eac69-315d-42f5-8ee7-eef065bbfc13'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.901048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eac64f25b184a0caad4c61edcb0700a', 'request_id': 'req-8b1eac69-315d-42f5-8ee7-eef065bbfc13'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.909607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae9c39-f391-462a-bd11-0f9e0e570f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:52.910613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae9c39-f391-462a-bd11-0f9e0e570f1e service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.911009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae9c39-f391-462a-bd11-0f9e0e570f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.911408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae9c39-f391-462a-bd11-0f9e0e570f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.917639 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] The token cache is being invalidate because project 9eac64f25b184a0caad4c61edcb0700a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:52.917931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.919167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8b1eac69-315d-42f5-8ee7-eef065bbfc13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:52.921561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1061/2122] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:52 2022] DELETE /identity/v3/projects/9eac64f25b184a0caad4c61edcb0700a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:52.928200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63bbb1-9131-4170-835f-07bd8d055d2f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:52.928564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63bbb1-9131-4170-835f-07bd8d055d2f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:52.929110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63bbb1-9131-4170-835f-07bd8d055d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:52.963046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4f63bbb1-9131-4170-835f-07bd8d055d2f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:52.963898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4f63bbb1-9131-4170-835f-07bd8d055d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.029800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae9c39-f391-462a-bd11-0f9e0e570f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.035209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae9c39-f391-462a-bd11-0f9e0e570f1e service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.057853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1062/2123] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:53.066923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae9c39-f391-462a-bd11-0f9e0e570f1e service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.066923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-98ae9c39-f391-462a-bd11-0f9e0e570f1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.084361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1062/2124] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:53.085938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ac23f-c71c-4848-9fba-dacfd335e961 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.086226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ac23f-c71c-4848-9fba-dacfd335e961 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.086497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ac23f-c71c-4848-9fba-dacfd335e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.100818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:53.163419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-101ac23f-c71c-4848-9fba-dacfd335e961 None None] MFA Rules not processed for user `1553810df7084cfa9451f2582043a423`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:53.166316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-101ac23f-c71c-4848-9fba-dacfd335e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.182958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae9c39-f391-462a-bd11-0f9e0e570f1e service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.207000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.207893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.208323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.208941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] PATH_INFO: `/v3/projects/62a3c82d15ee49719dc9dc76daf7968f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.211229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a3c82d15ee49719dc9dc76daf7968f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.214542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.285527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a3c82d15ee49719dc9dc76daf7968f', 'request_id': 'req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.296675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a3c82d15ee49719dc9dc76daf7968f', 'request_id': 'req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.299267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1063/2125] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:53.306353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a3c82d15ee49719dc9dc76daf7968f', 'request_id': 'req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.312904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffb41c-76ac-418a-9f2c-ca4abeba0d24 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.313195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffb41c-76ac-418a-9f2c-ca4abeba0d24 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.313503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffb41c-76ac-418a-9f2c-ca4abeba0d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.322765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] The token cache is being invalidate because project 62a3c82d15ee49719dc9dc76daf7968f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:53.323087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.324015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.331607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:53.331794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1063/2126] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:53 2022] DELETE /identity/v3/projects/62a3c82d15ee49719dc9dc76daf7968f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:53.332882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.336425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.344719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7fffb41c-76ac-418a-9f2c-ca4abeba0d24 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:53.349257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7fffb41c-76ac-418a-9f2c-ca4abeba0d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.429740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9114f2-4b92-4d9a-8aa0-b9616369c8a3 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.435122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.436004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.436509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.436968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] PATH_INFO: `/v3/users/0cb8dd0681aa425fa32475d6d7f34871` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.438370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb8dd0681aa425fa32475d6d7f34871)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.438489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1064/2127] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:53.439422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffb41c-76ac-418a-9f2c-ca4abeba0d24 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.441599 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.448538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7fffb41c-76ac-418a-9f2c-ca4abeba0d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.510122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb8dd0681aa425fa32475d6d7f34871'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.514750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:53.522950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb8dd0681aa425fa32475d6d7f34871'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.535222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb8dd0681aa425fa32475d6d7f34871'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.536193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb8dd0681aa425fa32475d6d7f34871'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.536519 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffb41c-76ac-418a-9f2c-ca4abeba0d24 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.542451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.543097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.543454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.543728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.545889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.550558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4a8f0240-94b1-434b-a76f-9494bc4be3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb8dd0681aa425fa32475d6d7f34871'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:53.574197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1064/2128] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:53 2022] DELETE /identity/v3/users/0cb8dd0681aa425fa32475d6d7f34871 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:53.574197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ab959-e75f-4894-9287-b179cc4007bd None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.574197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ab959-e75f-4894-9287-b179cc4007bd None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.574197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ab959-e75f-4894-9287-b179cc4007bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.602030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e66ab959-e75f-4894-9287-b179cc4007bd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:53.603312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e66ab959-e75f-4894-9287-b179cc4007bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.641823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.643404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.657667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1065/2129] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:53.658335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.660177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.677345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427afec-d37f-405b-8017-9a56008bb284 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.684480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d7512-72c5-4c5b-b64f-2790ac926466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.685108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7512-72c5-4c5b-b64f-2790ac926466 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.685417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7512-72c5-4c5b-b64f-2790ac926466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.685807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7512-72c5-4c5b-b64f-2790ac926466 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.686478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d7512-72c5-4c5b-b64f-2790ac926466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:53.686783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d7512-72c5-4c5b-b64f-2790ac926466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.688402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d7512-72c5-4c5b-b64f-2790ac926466 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.693069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1065/2130] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:53.696712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b549bd-42b6-4264-bcc8-f14e898ff7dc None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.697303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b549bd-42b6-4264-bcc8-f14e898ff7dc None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.705865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b549bd-42b6-4264-bcc8-f14e898ff7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.709782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1066/2131] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:53.709782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000cd13-8263-400e-a1e0-574842bc02fd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.709782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000cd13-8263-400e-a1e0-574842bc02fd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.709782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000cd13-8263-400e-a1e0-574842bc02fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.738996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-21b549bd-42b6-4264-bcc8-f14e898ff7dc None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:53.740443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-21b549bd-42b6-4264-bcc8-f14e898ff7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.744644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9000cd13-8263-400e-a1e0-574842bc02fd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:53.748357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9000cd13-8263-400e-a1e0-574842bc02fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.761395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1066/2132] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:53.761395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b549bd-42b6-4264-bcc8-f14e898ff7dc None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.772880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b549bd-42b6-4264-bcc8-f14e898ff7dc None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.777945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1067/2133] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:53.777945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000cd13-8263-400e-a1e0-574842bc02fd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.780822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9000cd13-8263-400e-a1e0-574842bc02fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:53.783952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5ccd-d12b-442c-859e-8508726dd0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.785085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5ccd-d12b-442c-859e-8508726dd0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.785404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5ccd-d12b-442c-859e-8508726dd0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.785683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5ccd-d12b-442c-859e-8508726dd0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.786557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5ccd-d12b-442c-859e-8508726dd0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.788940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5ccd-d12b-442c-859e-8508726dd0f2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.830327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1067/2134] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:53 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:53.831568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5ccd-d12b-442c-859e-8508726dd0f2 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:53.875998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:53.906803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000cd13-8263-400e-a1e0-574842bc02fd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.933802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5ccd-d12b-442c-859e-8508726dd0f2 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:53.947494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a49bfd-31f1-4270-baee-f3d7c635aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:53.948389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a49bfd-31f1-4270-baee-f3d7c635aa01 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:53.948825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a49bfd-31f1-4270-baee-f3d7c635aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:53.949098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a49bfd-31f1-4270-baee-f3d7c635aa01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:53.950067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a49bfd-31f1-4270-baee-f3d7c635aa01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:53.950371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a49bfd-31f1-4270-baee-f3d7c635aa01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:53.952380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a49bfd-31f1-4270-baee-f3d7c635aa01 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:53.972845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1068/2135] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:53.974530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a49bfd-31f1-4270-baee-f3d7c635aa01 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.000368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a49bfd-31f1-4270-baee-f3d7c635aa01 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.007268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b76d4e-3db6-49ec-afc0-6f2aa25f852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.007900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76d4e-3db6-49ec-afc0-6f2aa25f852c admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.008185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76d4e-3db6-49ec-afc0-6f2aa25f852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.008520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76d4e-3db6-49ec-afc0-6f2aa25f852c admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.009818 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b76d4e-3db6-49ec-afc0-6f2aa25f852c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.011842 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b76d4e-3db6-49ec-afc0-6f2aa25f852c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.021375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ed98f-cfac-4ec1-aaf0-0527ca57f2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.022384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ed98f-cfac-4ec1-aaf0-0527ca57f2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.024169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ed98f-cfac-4ec1-aaf0-0527ca57f2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.024513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ed98f-cfac-4ec1-aaf0-0527ca57f2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.042851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1069/2136] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:53 2022] POST /identity/v3/users => generated 293 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:54.045160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ed98f-cfac-4ec1-aaf0-0527ca57f2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.048395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b76d4e-3db6-49ec-afc0-6f2aa25f852c admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.048785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ed98f-cfac-4ec1-aaf0-0527ca57f2a9 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.063252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b76d4e-3db6-49ec-afc0-6f2aa25f852c admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.067391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1068/2137] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:54.069500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120e15b-db62-4191-a1da-1e9d60d4a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.070280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120e15b-db62-4191-a1da-1e9d60d4a646 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.070571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120e15b-db62-4191-a1da-1e9d60d4a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.070954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120e15b-db62-4191-a1da-1e9d60d4a646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.072465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120e15b-db62-4191-a1da-1e9d60d4a646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.074605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120e15b-db62-4191-a1da-1e9d60d4a646 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.086595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ed98f-cfac-4ec1-aaf0-0527ca57f2a9 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.091940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:54.115605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ed98f-cfac-4ec1-aaf0-0527ca57f2a9 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.117535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1070/2138] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:54 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:54.122125 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120e15b-db62-4191-a1da-1e9d60d4a646 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.271043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120e15b-db62-4191-a1da-1e9d60d4a646 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.281995 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e3ef5-ee82-45f2-8a6e-577582310240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.287479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf18ae-4fdd-43c0-904b-535b574aeb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.288114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf18ae-4fdd-43c0-904b-535b574aeb31 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.288394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf18ae-4fdd-43c0-904b-535b574aeb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.288809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf18ae-4fdd-43c0-904b-535b574aeb31 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.289021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e3ef5-ee82-45f2-8a6e-577582310240 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.289476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e3ef5-ee82-45f2-8a6e-577582310240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.289581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf18ae-4fdd-43c0-904b-535b574aeb31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.290700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e3ef5-ee82-45f2-8a6e-577582310240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.293018 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e3ef5-ee82-45f2-8a6e-577582310240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.294334 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf18ae-4fdd-43c0-904b-535b574aeb31 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.297617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e3ef5-ee82-45f2-8a6e-577582310240 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.341651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1069/2139] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:54.346796 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e3ef5-ee82-45f2-8a6e-577582310240 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.351709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1071/2140] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:54 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:54.354757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf18ae-4fdd-43c0-904b-535b574aeb31 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.376779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e3ef5-ee82-45f2-8a6e-577582310240 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.383954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf18ae-4fdd-43c0-904b-535b574aeb31 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.396497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c033e-fe21-4c3f-a3cd-64c59b27b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.397164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4d350-96b4-4a1e-a708-273aba28eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.398462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4d350-96b4-4a1e-a708-273aba28eb00 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.398462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4d350-96b4-4a1e-a708-273aba28eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.398641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4d350-96b4-4a1e-a708-273aba28eb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.399563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4d350-96b4-4a1e-a708-273aba28eb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.399850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c033e-fe21-4c3f-a3cd-64c59b27b236 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.401232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c033e-fe21-4c3f-a3cd-64c59b27b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.401673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4d350-96b4-4a1e-a708-273aba28eb00 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.401965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c033e-fe21-4c3f-a3cd-64c59b27b236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.404026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c033e-fe21-4c3f-a3cd-64c59b27b236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.407809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c033e-fe21-4c3f-a3cd-64c59b27b236 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.423062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1070/2141] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:54.424670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4d350-96b4-4a1e-a708-273aba28eb00 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.437213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1072/2142] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:54.440109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c033e-fe21-4c3f-a3cd-64c59b27b236 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.451314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4d350-96b4-4a1e-a708-273aba28eb00 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.469833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c033e-fe21-4c3f-a3cd-64c59b27b236 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.472564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b446a49-e890-400b-9ee8-cc03f3c93719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.473319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446a49-e890-400b-9ee8-cc03f3c93719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.473700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446a49-e890-400b-9ee8-cc03f3c93719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.474085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b446a49-e890-400b-9ee8-cc03f3c93719 admin admin] PATH_INFO: `/v3/projects/4b497bca6e654456a563392a6e5a11e1/users/000caf24118a4a4280b6e80f681cd8e7/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.487058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc686-55f7-4421-b0c6-c5675b759b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.487754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc686-55f7-4421-b0c6-c5675b759b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.488033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc686-55f7-4421-b0c6-c5675b759b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.490860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc686-55f7-4421-b0c6-c5675b759b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.491755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc686-55f7-4421-b0c6-c5675b759b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.501942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc686-55f7-4421-b0c6-c5675b759b48 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.511759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b446a49-e890-400b-9ee8-cc03f3c93719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b497bca6e654456a563392a6e5a11e1, user_id=000caf24118a4a4280b6e80f681cd8e7, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.519773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b446a49-e890-400b-9ee8-cc03f3c93719 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.530061 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1073/2143] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:54.534273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc686-55f7-4421-b0c6-c5675b759b48 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.550663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc686-55f7-4421-b0c6-c5675b759b48 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.565641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1071/2144] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:54 2022] PUT /identity/v3/projects/4b497bca6e654456a563392a6e5a11e1/users/000caf24118a4a4280b6e80f681cd8e7/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:54.575508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5de90-63d3-43e8-84b9-72c43d479317 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.575905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5de90-63d3-43e8-84b9-72c43d479317 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.576078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5de90-63d3-43e8-84b9-72c43d479317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.581829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8670078-1c89-4c5e-9d1a-d67f071370cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.582565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8670078-1c89-4c5e-9d1a-d67f071370cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.583592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8670078-1c89-4c5e-9d1a-d67f071370cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.584056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8670078-1c89-4c5e-9d1a-d67f071370cd admin admin] PATH_INFO: `/v3/projects/ce61af557cdf453dabcbb44881448a65/users/83209ece500f431085b45d216834d625/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.609270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8670078-1c89-4c5e-9d1a-d67f071370cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce61af557cdf453dabcbb44881448a65, user_id=83209ece500f431085b45d216834d625, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.612320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8670078-1c89-4c5e-9d1a-d67f071370cd admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.643517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1074/2145] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:54 2022] PUT /identity/v3/projects/ce61af557cdf453dabcbb44881448a65/users/83209ece500f431085b45d216834d625/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:54.661876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b63c-65b7-4ffe-82d3-5999efd75995 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.662913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b63c-65b7-4ffe-82d3-5999efd75995 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.663833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31b63c-65b7-4ffe-82d3-5999efd75995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.677056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d3d5de90-63d3-43e8-84b9-72c43d479317 None None] MFA Rules not processed for user `000caf24118a4a4280b6e80f681cd8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:54.681397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d3d5de90-63d3-43e8-84b9-72c43d479317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:54.749669 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3e31b63c-65b7-4ffe-82d3-5999efd75995 None None] MFA Rules not processed for user `83209ece500f431085b45d216834d625`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:54.751727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3e31b63c-65b7-4ffe-82d3-5999efd75995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:54.797072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:54.821197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1072/2146] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:54.822263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5de90-63d3-43e8-84b9-72c43d479317 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.824045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d3d5de90-63d3-43e8-84b9-72c43d479317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:54.859585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1075/2147] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:54.859585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31b63c-65b7-4ffe-82d3-5999efd75995 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:54.859585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3e31b63c-65b7-4ffe-82d3-5999efd75995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:54.898015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:54.916743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5de90-63d3-43e8-84b9-72c43d479317 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.926844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.927738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.928162 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.928733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] PATH_INFO: `/v3/projects/5a4e83d95bd84120b64f40d815de0e55` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.930762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4e83d95bd84120b64f40d815de0e55)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.932418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31b63c-65b7-4ffe-82d3-5999efd75995 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:54.934350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.938739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14d8b5-1e05-45c5-8397-39f7b32372ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:54.939490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14d8b5-1e05-45c5-8397-39f7b32372ae service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:54.939868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14d8b5-1e05-45c5-8397-39f7b32372ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:54.940266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14d8b5-1e05-45c5-8397-39f7b32372ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:54.951633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14d8b5-1e05-45c5-8397-39f7b32372ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:54.953884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14d8b5-1e05-45c5-8397-39f7b32372ae service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:54.967202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1076/2148] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:54.978691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14d8b5-1e05-45c5-8397-39f7b32372ae service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.009657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14d8b5-1e05-45c5-8397-39f7b32372ae service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:55.029922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4e83d95bd84120b64f40d815de0e55', 'request_id': 'req-632d7579-f786-458d-9372-7f67975938c6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.042342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4e83d95bd84120b64f40d815de0e55', 'request_id': 'req-632d7579-f786-458d-9372-7f67975938c6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.053196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4e83d95bd84120b64f40d815de0e55', 'request_id': 'req-632d7579-f786-458d-9372-7f67975938c6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.069164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] The token cache is being invalidate because project 5a4e83d95bd84120b64f40d815de0e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:55.069724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.072760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.075539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1073/2149] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:54 2022] DELETE /identity/v3/projects/5a4e83d95bd84120b64f40d815de0e55 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:55.076103 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adf46b-91d4-4ca3-aaea-995ced8211d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:55.076684 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.076918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adf46b-91d4-4ca3-aaea-995ced8211d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.077289 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adf46b-91d4-4ca3-aaea-995ced8211d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.077680 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adf46b-91d4-4ca3-aaea-995ced8211d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.078445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adf46b-91d4-4ca3-aaea-995ced8211d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:55.079037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.080751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adf46b-91d4-4ca3-aaea-995ced8211d0 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:55.097134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d7579-f786-458d-9372-7f67975938c6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:55.104446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:55.105983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.106435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.106945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] PATH_INFO: `/v3/users/000caf24118a4a4280b6e80f681cd8e7` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.109597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=000caf24118a4a4280b6e80f681cd8e7)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:55.111716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:55.115238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1077/2150] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:54 2022] POST /identity/v3/projects => generated 391 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:55.116695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fac8-5ddb-4de8-9780-4a5ff3a84536 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.117197 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fac8-5ddb-4de8-9780-4a5ff3a84536 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.117596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fac8-5ddb-4de8-9780-4a5ff3a84536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.142820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-0ed5fac8-5ddb-4de8-9780-4a5ff3a84536 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:55.144729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0ed5fac8-5ddb-4de8-9780-4a5ff3a84536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.184143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000caf24118a4a4280b6e80f681cd8e7'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.197106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000caf24118a4a4280b6e80f681cd8e7'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.214882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000caf24118a4a4280b6e80f681cd8e7'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.216039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000caf24118a4a4280b6e80f681cd8e7'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.216880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-635eeeb9-6623-4b8f-8920-6915c5dbbccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000caf24118a4a4280b6e80f681cd8e7'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:55.218856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1078/2151] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:55.219860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5fac8-5ddb-4de8-9780-4a5ff3a84536 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.221199 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0ed5fac8-5ddb-4de8-9780-4a5ff3a84536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.231269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:55.233932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5fac8-5ddb-4de8-9780-4a5ff3a84536 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:55.241481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b055a-3fc2-4144-9ac3-c6e7d485862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:55.242272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b055a-3fc2-4144-9ac3-c6e7d485862a admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.242653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b055a-3fc2-4144-9ac3-c6e7d485862a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.243060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b055a-3fc2-4144-9ac3-c6e7d485862a admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.243871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b055a-3fc2-4144-9ac3-c6e7d485862a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:55.245284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1074/2152] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:36:55 2022] DELETE /identity/v3/users/000caf24118a4a4280b6e80f681cd8e7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:55.246938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731c28-bcd0-4857-bacb-3cc1bac0a1c6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.248365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731c28-bcd0-4857-bacb-3cc1bac0a1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.249104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a731c28-bcd0-4857-bacb-3cc1bac0a1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.250476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b055a-3fc2-4144-9ac3-c6e7d485862a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:55.286929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1079/2153] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:55 2022] POST /identity/v3/users => generated 302 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:55.288339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417bbce-328a-4412-a02b-1f8bcd2b89fd None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.290771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417bbce-328a-4412-a02b-1f8bcd2b89fd None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.291336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417bbce-328a-4412-a02b-1f8bcd2b89fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.296957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9a731c28-bcd0-4857-bacb-3cc1bac0a1c6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:55.298221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9a731c28-bcd0-4857-bacb-3cc1bac0a1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.320082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f417bbce-328a-4412-a02b-1f8bcd2b89fd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:55.322163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f417bbce-328a-4412-a02b-1f8bcd2b89fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.379648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:55.409943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1075/2154] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:55.411682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a731c28-bcd0-4857-bacb-3cc1bac0a1c6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.413590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9a731c28-bcd0-4857-bacb-3cc1bac0a1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.429384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a731c28-bcd0-4857-bacb-3cc1bac0a1c6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:55.434806 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1080/2155] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:55.435622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ad7b-6f46-421f-91f2-4e0fb67426f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:55.436406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ad7b-6f46-421f-91f2-4e0fb67426f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.436821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ad7b-6f46-421f-91f2-4e0fb67426f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.437241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ad7b-6f46-421f-91f2-4e0fb67426f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.437655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f499fd-d5a7-4eed-8d73-306aeefb4bbb None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.438975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f499fd-d5a7-4eed-8d73-306aeefb4bbb None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.439317 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0ad7b-6f46-421f-91f2-4e0fb67426f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:55.439429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f499fd-d5a7-4eed-8d73-306aeefb4bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.441312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0ad7b-6f46-421f-91f2-4e0fb67426f5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:55.459574 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1076/2156] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:55.460970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ad7b-6f46-421f-91f2-4e0fb67426f5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.477830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-63f499fd-d5a7-4eed-8d73-306aeefb4bbb None None] MFA Rules not processed for user `1553810df7084cfa9451f2582043a423`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:55.479181 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-63f499fd-d5a7-4eed-8d73-306aeefb4bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.486650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ad7b-6f46-421f-91f2-4e0fb67426f5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:55.493724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:55.494382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.494653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.495418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.495750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:55.496057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:55.497696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:55.517362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1077/2157] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:55.518234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.532322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.643326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1081/2158] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:55.643326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f499fd-d5a7-4eed-8d73-306aeefb4bbb None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.651762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a5c91-3294-4f88-a2e5-d22279edf958 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:55.661235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d32da-02f6-48d4-a57f-cf882a5268b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:55.662173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d32da-02f6-48d4-a57f-cf882a5268b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.662552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d32da-02f6-48d4-a57f-cf882a5268b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.662924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d32da-02f6-48d4-a57f-cf882a5268b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.667296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f499fd-d5a7-4eed-8d73-306aeefb4bbb None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:55.674288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5e0a-ce95-4c72-a147-c4d891829504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:55.675151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5e0a-ce95-4c72-a147-c4d891829504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.675245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5e0a-ce95-4c72-a147-c4d891829504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.675492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5e0a-ce95-4c72-a147-c4d891829504 admin admin] PATH_INFO: `/v3/projects/0f8a4e68eadc406c982d5cce5f9cae39/users/363ac288fc0b43119bbed433866e5fad/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.684495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d32da-02f6-48d4-a57f-cf882a5268b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:55.686449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d32da-02f6-48d4-a57f-cf882a5268b2 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:55.713731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1078/2159] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:55.716158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d32da-02f6-48d4-a57f-cf882a5268b2 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.740776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d32da-02f6-48d4-a57f-cf882a5268b2 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:55.751783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5e0a-ce95-4c72-a147-c4d891829504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8a4e68eadc406c982d5cce5f9cae39, user_id=363ac288fc0b43119bbed433866e5fad, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:55.754489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a5e0a-ce95-4c72-a147-c4d891829504 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:55.763235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047f95b-a9bd-4caa-b37a-dc569874e6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:55.763964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047f95b-a9bd-4caa-b37a-dc569874e6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.766318 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047f95b-a9bd-4caa-b37a-dc569874e6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.766700 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047f95b-a9bd-4caa-b37a-dc569874e6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.767764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047f95b-a9bd-4caa-b37a-dc569874e6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:55.776628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047f95b-a9bd-4caa-b37a-dc569874e6e9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:55.789376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1082/2160] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:55 2022] PUT /identity/v3/projects/0f8a4e68eadc406c982d5cce5f9cae39/users/363ac288fc0b43119bbed433866e5fad/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:55.798644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636fbce-3b31-48cf-840c-5e254daa99b2 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:55.799192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636fbce-3b31-48cf-840c-5e254daa99b2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:55.799353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636fbce-3b31-48cf-840c-5e254daa99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:55.843525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1079/2161] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:55 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:55.844514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047f95b-a9bd-4caa-b37a-dc569874e6e9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:55.847147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-c636fbce-3b31-48cf-840c-5e254daa99b2 None None] MFA Rules not processed for user `bb8f655ed67d46a5b4211a851f8da02d`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:55.848614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c636fbce-3b31-48cf-840c-5e254daa99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:55.981169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:56.024038 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047f95b-a9bd-4caa-b37a-dc569874e6e9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.040648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92670-4cbc-4f1c-bc83-b1a9292a0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.041423 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92670-4cbc-4f1c-bc83-b1a9292a0909 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.041620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92670-4cbc-4f1c-bc83-b1a9292a0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.041897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92670-4cbc-4f1c-bc83-b1a9292a0909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.042610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d92670-4cbc-4f1c-bc83-b1a9292a0909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.044689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d92670-4cbc-4f1c-bc83-b1a9292a0909 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.056868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1083/2162] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:56.068494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636fbce-3b31-48cf-840c-5e254daa99b2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:56.070934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1080/2163] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:56.074583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92670-4cbc-4f1c-bc83-b1a9292a0909 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:56.077537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-98d92670-4cbc-4f1c-bc83-b1a9292a0909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:56.095157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636fbce-3b31-48cf-840c-5e254daa99b2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.104265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314382b-5e84-4f7d-bf33-867b1fa28887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.105225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314382b-5e84-4f7d-bf33-867b1fa28887 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.105556 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314382b-5e84-4f7d-bf33-867b1fa28887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.105835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314382b-5e84-4f7d-bf33-867b1fa28887 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.106654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314382b-5e84-4f7d-bf33-867b1fa28887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.109828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314382b-5e84-4f7d-bf33-867b1fa28887 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.155268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1084/2164] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:56 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:56.159919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314382b-5e84-4f7d-bf33-867b1fa28887 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:56.172032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314382b-5e84-4f7d-bf33-867b1fa28887 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.182314 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f99c6-6dac-416e-8b51-b79d57e244e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.183059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f99c6-6dac-416e-8b51-b79d57e244e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.183429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f99c6-6dac-416e-8b51-b79d57e244e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.184839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f99c6-6dac-416e-8b51-b79d57e244e8 admin admin] PATH_INFO: `/v3/projects/0f8a4e68eadc406c982d5cce5f9cae39/users/363ac288fc0b43119bbed433866e5fad/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.189476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f99c6-6dac-416e-8b51-b79d57e244e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8a4e68eadc406c982d5cce5f9cae39, user_id=363ac288fc0b43119bbed433866e5fad, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.190113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92670-4cbc-4f1c-bc83-b1a9292a0909 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.193578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f99c6-6dac-416e-8b51-b79d57e244e8 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.199090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b908026-eb89-4d3d-bbf2-d8cbab36bd0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.199916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b908026-eb89-4d3d-bbf2-d8cbab36bd0b service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.200229 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b908026-eb89-4d3d-bbf2-d8cbab36bd0b service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.200569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b908026-eb89-4d3d-bbf2-d8cbab36bd0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.219101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b908026-eb89-4d3d-bbf2-d8cbab36bd0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.219101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b908026-eb89-4d3d-bbf2-d8cbab36bd0b service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.220835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1085/2165] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:56 2022] PUT /identity/v3/projects/0f8a4e68eadc406c982d5cce5f9cae39/users/363ac288fc0b43119bbed433866e5fad/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:56.222489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f99c6-6dac-416e-8b51-b79d57e244e8 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:56.230521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1081/2166] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:56.253464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:56.261403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aabc2-ac4e-401e-96d0-c40151c02fdb None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.262409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aabc2-ac4e-401e-96d0-c40151c02fdb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.263508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aabc2-ac4e-401e-96d0-c40151c02fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.338757 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5e5aabc2-ac4e-401e-96d0-c40151c02fdb None None] MFA Rules not processed for user `363ac288fc0b43119bbed433866e5fad`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:56.341180 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5e5aabc2-ac4e-401e-96d0-c40151c02fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:56.395593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f99c6-6dac-416e-8b51-b79d57e244e8 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.401728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fc745-bd7f-4d94-8dd7-4d8e4d4de627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.402375 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fc745-bd7f-4d94-8dd7-4d8e4d4de627 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.402713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fc745-bd7f-4d94-8dd7-4d8e4d4de627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.402973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fc745-bd7f-4d94-8dd7-4d8e4d4de627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.404173 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fc745-bd7f-4d94-8dd7-4d8e4d4de627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.407146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fc745-bd7f-4d94-8dd7-4d8e4d4de627 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.439483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1086/2167] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:56.447466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fc745-bd7f-4d94-8dd7-4d8e4d4de627 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:56.478538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fc745-bd7f-4d94-8dd7-4d8e4d4de627 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.485621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6971-a25c-45dc-bdb3-42c7d60f5144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.486614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6971-a25c-45dc-bdb3-42c7d60f5144 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.487114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6971-a25c-45dc-bdb3-42c7d60f5144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.487710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e6971-a25c-45dc-bdb3-42c7d60f5144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.488636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e6971-a25c-45dc-bdb3-42c7d60f5144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.490948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e6971-a25c-45dc-bdb3-42c7d60f5144 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.509045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1087/2168] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:56.510414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6971-a25c-45dc-bdb3-42c7d60f5144 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:56.522151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e6971-a25c-45dc-bdb3-42c7d60f5144 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.527891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417e9f6-6c03-4b07-94bb-289744d5f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.528583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417e9f6-6c03-4b07-94bb-289744d5f38e admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.529235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417e9f6-6c03-4b07-94bb-289744d5f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.529235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417e9f6-6c03-4b07-94bb-289744d5f38e admin admin] PATH_INFO: `/v3/projects/76ef05de5862494999c2c38ba70d54a4/users/0f027255e9614ef88f134b7c385f36d7/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.542978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1082/2169] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:56.556577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5aabc2-ac4e-401e-96d0-c40151c02fdb None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:56.558800 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5e5aabc2-ac4e-401e-96d0-c40151c02fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:56.564313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417e9f6-6c03-4b07-94bb-289744d5f38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ef05de5862494999c2c38ba70d54a4, user_id=0f027255e9614ef88f134b7c385f36d7, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.567234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417e9f6-6c03-4b07-94bb-289744d5f38e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.596546 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1088/2170] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:56 2022] PUT /identity/v3/projects/76ef05de5862494999c2c38ba70d54a4/users/0f027255e9614ef88f134b7c385f36d7/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:36:56.607595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde365e-dd5f-4bcf-9b72-6a92bf9b7e1b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.609355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde365e-dd5f-4bcf-9b72-6a92bf9b7e1b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.609642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde365e-dd5f-4bcf-9b72-6a92bf9b7e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.691349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-cfde365e-dd5f-4bcf-9b72-6a92bf9b7e1b None None] MFA Rules not processed for user `0f027255e9614ef88f134b7c385f36d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:56.692763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-cfde365e-dd5f-4bcf-9b72-6a92bf9b7e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:56.734692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5aabc2-ac4e-401e-96d0-c40151c02fdb None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.765662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:56.836030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1089/2171] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:56.843952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9589092-5b3b-4571-8cd3-cbb451633bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.844585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9589092-5b3b-4571-8cd3-cbb451633bad service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.844869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9589092-5b3b-4571-8cd3-cbb451633bad service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.845148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9589092-5b3b-4571-8cd3-cbb451633bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.851108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde365e-dd5f-4bcf-9b72-6a92bf9b7e1b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:56.853124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-cfde365e-dd5f-4bcf-9b72-6a92bf9b7e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:56.869253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde365e-dd5f-4bcf-9b72-6a92bf9b7e1b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:56.873277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e7344-07da-461d-8c39-880a578b1499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:56.874092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e7344-07da-461d-8c39-880a578b1499 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:56.874374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e7344-07da-461d-8c39-880a578b1499 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:56.874644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e7344-07da-461d-8c39-880a578b1499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:56.890453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e7344-07da-461d-8c39-880a578b1499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.891906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e7344-07da-461d-8c39-880a578b1499 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.911923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1090/2172] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:56.937616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9589092-5b3b-4571-8cd3-cbb451633bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:56.945175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9589092-5b3b-4571-8cd3-cbb451633bad service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:56.957321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e7344-07da-461d-8c39-880a578b1499 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:56.957919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1083/2173] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:36:56.958976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-903e7344-07da-461d-8c39-880a578b1499 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:57.059707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9589092-5b3b-4571-8cd3-cbb451633bad service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:57.074533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9589092-5b3b-4571-8cd3-cbb451633bad service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:57.102340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e8fa0-9b47-4e4e-bdd2-509bef0c4d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:57.103307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e8fa0-9b47-4e4e-bdd2-509bef0c4d75 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.104071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e8fa0-9b47-4e4e-bdd2-509bef0c4d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.104458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e8fa0-9b47-4e4e-bdd2-509bef0c4d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.107433 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-946e8fa0-9b47-4e4e-bdd2-509bef0c4d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:57.139934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:57.163611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e7344-07da-461d-8c39-880a578b1499 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:57.185950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:57.186579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.186809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.187207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] PATH_INFO: `/v3/projects/4b497bca6e654456a563392a6e5a11e1` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.191449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b497bca6e654456a563392a6e5a11e1)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:57.197377 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:57.267959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e8fa0-9b47-4e4e-bdd2-509bef0c4d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:57.270685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e8fa0-9b47-4e4e-bdd2-509bef0c4d75 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:57.299046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1084/2174] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:36:57.374737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b497bca6e654456a563392a6e5a11e1', 'request_id': 'req-00e045d3-4339-4f11-b824-2a392db25bbc'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.427694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b497bca6e654456a563392a6e5a11e1', 'request_id': 'req-00e045d3-4339-4f11-b824-2a392db25bbc'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.442480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b497bca6e654456a563392a6e5a11e1', 'request_id': 'req-00e045d3-4339-4f11-b824-2a392db25bbc'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.476340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] The token cache is being invalidate because project 4b497bca6e654456a563392a6e5a11e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:36:57.476645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.483473 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-00e045d3-4339-4f11-b824-2a392db25bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:36:57.492553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1091/2175] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:36:56 2022] DELETE /identity/v3/projects/4b497bca6e654456a563392a6e5a11e1 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:57.494730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b994d67-3e4e-4267-af08-51f92cea18b5 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.495028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b994d67-3e4e-4267-af08-51f92cea18b5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.495313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b994d67-3e4e-4267-af08-51f92cea18b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.538203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3b994d67-3e4e-4267-af08-51f92cea18b5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:57.540310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3b994d67-3e4e-4267-af08-51f92cea18b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:57.685857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686f80-8ee1-4c46-80cf-cd10f7f322db None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.686142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686f80-8ee1-4c46-80cf-cd10f7f322db None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.686418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686f80-8ee1-4c46-80cf-cd10f7f322db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.692013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1085/2176] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:57.729740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-47686f80-8ee1-4c46-80cf-cd10f7f322db None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:57.733866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-47686f80-8ee1-4c46-80cf-cd10f7f322db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:57.752019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1092/2177] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:36:57.757454 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b994d67-3e4e-4267-af08-51f92cea18b5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:57.763830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:57.770847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b994d67-3e4e-4267-af08-51f92cea18b5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:57.780609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6783a-42cd-48f1-aad0-fd5cce1e22c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:57.780837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6783a-42cd-48f1-aad0-fd5cce1e22c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.781124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6783a-42cd-48f1-aad0-fd5cce1e22c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.781394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6783a-42cd-48f1-aad0-fd5cce1e22c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.782095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6783a-42cd-48f1-aad0-fd5cce1e22c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:36:57.783312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6783a-42cd-48f1-aad0-fd5cce1e22c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:57.787426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6783a-42cd-48f1-aad0-fd5cce1e22c5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:57.806092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1086/2178] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:36:57.807290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47686f80-8ee1-4c46-80cf-cd10f7f322db None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:57.823455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47686f80-8ee1-4c46-80cf-cd10f7f322db None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:57.850587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f34bf3-5bbb-4f68-abaf-e9ebc663a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:57.851395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f34bf3-5bbb-4f68-abaf-e9ebc663a2bc admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:57.852626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f34bf3-5bbb-4f68-abaf-e9ebc663a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:57.853028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f34bf3-5bbb-4f68-abaf-e9ebc663a2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:57.854440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f34bf3-5bbb-4f68-abaf-e9ebc663a2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:57.857080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f34bf3-5bbb-4f68-abaf-e9ebc663a2bc admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:57.949272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1093/2179] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:36:57 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:36:57.953047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6783a-42cd-48f1-aad0-fd5cce1e22c5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:57.968142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6783a-42cd-48f1-aad0-fd5cce1e22c5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:58.094091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52d8a5-1420-4ce3-be92-06f7298281ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:58.094906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52d8a5-1420-4ce3-be92-06f7298281ee admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.095233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52d8a5-1420-4ce3-be92-06f7298281ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.095618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52d8a5-1420-4ce3-be92-06f7298281ee admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.096378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52d8a5-1420-4ce3-be92-06f7298281ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:58.101790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52d8a5-1420-4ce3-be92-06f7298281ee admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:58.166736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1087/2180] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:36:57 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:36:58.170423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f34bf3-5bbb-4f68-abaf-e9ebc663a2bc admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:58.186468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f34bf3-5bbb-4f68-abaf-e9ebc663a2bc admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:58.196913 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba748-c71a-452d-975b-5641c2972e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:58.197610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba748-c71a-452d-975b-5641c2972e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.197892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba748-c71a-452d-975b-5641c2972e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.198170 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba748-c71a-452d-975b-5641c2972e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.199896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdba748-c71a-452d-975b-5641c2972e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:58.200979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdba748-c71a-452d-975b-5641c2972e1e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:58.214590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1094/2181] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:36:58.223559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52d8a5-1420-4ce3-be92-06f7298281ee admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:58.239920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52d8a5-1420-4ce3-be92-06f7298281ee admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:58.251215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb3a65-ab51-41a9-83fa-d02745058b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:58.254047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb3a65-ab51-41a9-83fa-d02745058b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.255756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb3a65-ab51-41a9-83fa-d02745058b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.255756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb3a65-ab51-41a9-83fa-d02745058b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.257815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb3a65-ab51-41a9-83fa-d02745058b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:58.274587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb3a65-ab51-41a9-83fa-d02745058b81 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:58.298292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1088/2182] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:36:58.298968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba748-c71a-452d-975b-5641c2972e1e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:58.311233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba748-c71a-452d-975b-5641c2972e1e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:58.323785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb9820-6d37-4246-aeb3-b342de30600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:58.324260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9820-6d37-4246-aeb3-b342de30600b admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.324721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9820-6d37-4246-aeb3-b342de30600b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.325166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9820-6d37-4246-aeb3-b342de30600b admin admin] PATH_INFO: `/v3/projects/6139fc3351e34136855270cf58081c11/users/3a38fc4c81a14b3d8af18409236846bf/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.355059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb9820-6d37-4246-aeb3-b342de30600b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6139fc3351e34136855270cf58081c11, user_id=3a38fc4c81a14b3d8af18409236846bf, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:58.358115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb9820-6d37-4246-aeb3-b342de30600b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:58.392192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1095/2183] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:36:58 2022] PUT /identity/v3/projects/6139fc3351e34136855270cf58081c11/users/3a38fc4c81a14b3d8af18409236846bf/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:36:58.394502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9abf-4651-4cd3-ac9b-9feea15f6f93 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.394790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9abf-4651-4cd3-ac9b-9feea15f6f93 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.395057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9abf-4651-4cd3-ac9b-9feea15f6f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.463286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e83e9abf-4651-4cd3-ac9b-9feea15f6f93 None None] MFA Rules not processed for user `3a38fc4c81a14b3d8af18409236846bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:58.464540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e83e9abf-4651-4cd3-ac9b-9feea15f6f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:58.596736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97760f-2b0a-4fe7-8378-945a3aad48f6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.597043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97760f-2b0a-4fe7-8378-945a3aad48f6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.597952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97760f-2b0a-4fe7-8378-945a3aad48f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.626873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8a97760f-2b0a-4fe7-8378-945a3aad48f6 None None] MFA Rules not processed for user `0f027255e9614ef88f134b7c385f36d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:36:58.628218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8a97760f-2b0a-4fe7-8378-945a3aad48f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:58.639370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1089/2184] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:58.654878 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e9abf-4651-4cd3-ac9b-9feea15f6f93 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:36:58.656806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e83e9abf-4651-4cd3-ac9b-9feea15f6f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:36:58.730439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e9abf-4651-4cd3-ac9b-9feea15f6f93 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:36:58.735802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5788-1fb7-4214-a392-c2ee1e94b4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:36:58.737198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5788-1fb7-4214-a392-c2ee1e94b4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:36:58.737667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5788-1fb7-4214-a392-c2ee1e94b4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:36:58.738087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5788-1fb7-4214-a392-c2ee1e94b4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:36:58.752649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1096/2185] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:36:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:36:58.754747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa5788-1fb7-4214-a392-c2ee1e94b4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:36:58.758023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa5788-1fb7-4214-a392-c2ee1e94b4b1 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:36:58.766103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:36:58.813930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1090/2186] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:36:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:00.229122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b550229-603c-4b33-8043-f725092b15b2 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:00.230566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b550229-603c-4b33-8043-f725092b15b2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:00.230993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b550229-603c-4b33-8043-f725092b15b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:00.283461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-7b550229-603c-4b33-8043-f725092b15b2 None None] MFA Rules not processed for user `bb8f655ed67d46a5b4211a851f8da02d`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:00.285287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7b550229-603c-4b33-8043-f725092b15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:00.334506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:00.386658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1097/2187] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:02.029199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5788-1fb7-4214-a392-c2ee1e94b4b1 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:02.031000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cffa5788-1fb7-4214-a392-c2ee1e94b4b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:02.205655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b550229-603c-4b33-8043-f725092b15b2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:02.241714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5788-1fb7-4214-a392-c2ee1e94b4b1 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:02.257124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:02.258204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:02.259910 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:02.260349 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] PATH_INFO: `/v3/users/83209ece500f431085b45d216834d625` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:02.264765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83209ece500f431085b45d216834d625)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:02.266984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:02.357521 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b550229-603c-4b33-8043-f725092b15b2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:02.367230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83209ece500f431085b45d216834d625'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.368101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:02.368936 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:02.369428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:02.369868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] PATH_INFO: `/v3/users/3a38fc4c81a14b3d8af18409236846bf` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:02.371290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a38fc4c81a14b3d8af18409236846bf)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:02.373462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:02.382703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83209ece500f431085b45d216834d625'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.393777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83209ece500f431085b45d216834d625'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.394512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83209ece500f431085b45d216834d625'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.395123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-591b1a1d-f2ae-4e12-967c-f44fd7f19937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83209ece500f431085b45d216834d625'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.434079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1091/2188] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:02 2022] DELETE /identity/v3/users/83209ece500f431085b45d216834d625 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:02.438997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91af9-1112-4624-9c52-17dd2eee6d20 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:02.439541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91af9-1112-4624-9c52-17dd2eee6d20 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:02.440081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e91af9-1112-4624-9c52-17dd2eee6d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:02.440331 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a38fc4c81a14b3d8af18409236846bf'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.455246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a38fc4c81a14b3d8af18409236846bf'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.465766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a38fc4c81a14b3d8af18409236846bf'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.468129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a38fc4c81a14b3d8af18409236846bf'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.471791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e0e91af9-1112-4624-9c52-17dd2eee6d20 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:02.475449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e0e91af9-1112-4624-9c52-17dd2eee6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:02.505596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a931211a-b9e3-492d-863a-7f9f7f95c333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a38fc4c81a14b3d8af18409236846bf'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:02.532559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1098/2189] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:02 2022] DELETE /identity/v3/users/3a38fc4c81a14b3d8af18409236846bf => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:02.538152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20d614-cab7-4615-a8ca-cd55169dcdef None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:02.538609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20d614-cab7-4615-a8ca-cd55169dcdef None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:02.538890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20d614-cab7-4615-a8ca-cd55169dcdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:02.596835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2b20d614-cab7-4615-a8ca-cd55169dcdef None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:02.598331 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2b20d614-cab7-4615-a8ca-cd55169dcdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:02.643934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1092/2190] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:02.697867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e91af9-1112-4624-9c52-17dd2eee6d20 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:02.699544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e0e91af9-1112-4624-9c52-17dd2eee6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:02.709973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:02.740363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:02.746939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1099/2191] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:02.756887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20d614-cab7-4615-a8ca-cd55169dcdef None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:02.762989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2b20d614-cab7-4615-a8ca-cd55169dcdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:02.807600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e91af9-1112-4624-9c52-17dd2eee6d20 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:02.879706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20d614-cab7-4615-a8ca-cd55169dcdef None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:02.888228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186a87b-0046-42b0-9680-6d1c6baef7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:02.889491 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186a87b-0046-42b0-9680-6d1c6baef7fa service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:02.889773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186a87b-0046-42b0-9680-6d1c6baef7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:02.890045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186a87b-0046-42b0-9680-6d1c6baef7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:02.894721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52418a90-e5d5-4d36-bb5d-df13dc88c894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:02.895394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52418a90-e5d5-4d36-bb5d-df13dc88c894 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:02.895673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52418a90-e5d5-4d36-bb5d-df13dc88c894 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:02.895945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52418a90-e5d5-4d36-bb5d-df13dc88c894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:02.906426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186a87b-0046-42b0-9680-6d1c6baef7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:02.908821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186a87b-0046-42b0-9680-6d1c6baef7fa service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:02.915240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52418a90-e5d5-4d36-bb5d-df13dc88c894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:02.917872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52418a90-e5d5-4d36-bb5d-df13dc88c894 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:02.921154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1100/2192] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:02.931496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1093/2193] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:03.788802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186a87b-0046-42b0-9680-6d1c6baef7fa service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:03.790887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3186a87b-0046-42b0-9680-6d1c6baef7fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:03.814337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186a87b-0046-42b0-9680-6d1c6baef7fa service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:03.819964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:03.820644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:03.820923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:03.821194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] PATH_INFO: `/v3/projects/6139fc3351e34136855270cf58081c11` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:03.823311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6139fc3351e34136855270cf58081c11)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:03.824325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:03.903945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6139fc3351e34136855270cf58081c11', 'request_id': 'req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:03.916663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6139fc3351e34136855270cf58081c11', 'request_id': 'req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:03.926209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6139fc3351e34136855270cf58081c11', 'request_id': 'req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:03.943627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] The token cache is being invalidate because project 6139fc3351e34136855270cf58081c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:03.944315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:03.945047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fc11e0dd-7c2b-4af8-adc9-b1530bf7ff2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:03.946823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1101/2194] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:03 2022] DELETE /identity/v3/projects/6139fc3351e34136855270cf58081c11 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:03.951789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b9a32-3b73-45ee-990b-2407973b044d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:03.952261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b9a32-3b73-45ee-990b-2407973b044d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:03.952437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b9a32-3b73-45ee-990b-2407973b044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:03.979453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-846b9a32-3b73-45ee-990b-2407973b044d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:03.980871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-846b9a32-3b73-45ee-990b-2407973b044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:04.061383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1094/2195] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:04.066456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff56ad9-c61b-4414-9fdc-7fcecf13b72d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.066732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff56ad9-c61b-4414-9fdc-7fcecf13b72d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.067550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff56ad9-c61b-4414-9fdc-7fcecf13b72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.111981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2ff56ad9-c61b-4414-9fdc-7fcecf13b72d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:04.114532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2ff56ad9-c61b-4414-9fdc-7fcecf13b72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:04.128901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1102/2196] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:04.134680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b9a32-3b73-45ee-990b-2407973b044d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.150969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b9a32-3b73-45ee-990b-2407973b044d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:04.155746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd75ae-90b2-420e-96b5-5ed5e35c6c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:04.156670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd75ae-90b2-420e-96b5-5ed5e35c6c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.156670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd75ae-90b2-420e-96b5-5ed5e35c6c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.157604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd75ae-90b2-420e-96b5-5ed5e35c6c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.158319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd75ae-90b2-420e-96b5-5ed5e35c6c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:04.159066 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd75ae-90b2-420e-96b5-5ed5e35c6c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:04.161023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd75ae-90b2-420e-96b5-5ed5e35c6c93 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:04.175950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1095/2197] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:04.179869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff56ad9-c61b-4414-9fdc-7fcecf13b72d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.191820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff56ad9-c61b-4414-9fdc-7fcecf13b72d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:04.197501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598b9e7-043f-425d-ac3f-17456071c782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:04.198208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598b9e7-043f-425d-ac3f-17456071c782 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.198552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598b9e7-043f-425d-ac3f-17456071c782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.198883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598b9e7-043f-425d-ac3f-17456071c782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.199727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598b9e7-043f-425d-ac3f-17456071c782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:04.201876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598b9e7-043f-425d-ac3f-17456071c782 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:04.251997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1103/2198] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:04 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:04.252286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd75ae-90b2-420e-96b5-5ed5e35c6c93 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.267962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd75ae-90b2-420e-96b5-5ed5e35c6c93 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:04.415146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08346e4d-0b90-466c-81c2-4a17894a08ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:04.415903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08346e4d-0b90-466c-81c2-4a17894a08ea admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.416792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08346e4d-0b90-466c-81c2-4a17894a08ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.417169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08346e4d-0b90-466c-81c2-4a17894a08ea admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.419208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08346e4d-0b90-466c-81c2-4a17894a08ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:04.421320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08346e4d-0b90-466c-81c2-4a17894a08ea admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:04.453614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:04.479644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1096/2199] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:04 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:04.483828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598b9e7-043f-425d-ac3f-17456071c782 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.500992 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598b9e7-043f-425d-ac3f-17456071c782 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:04.514723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ece91e-f6fd-47bc-bff2-e41e08f53217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:04.517296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ece91e-f6fd-47bc-bff2-e41e08f53217 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.517296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ece91e-f6fd-47bc-bff2-e41e08f53217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.517296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ece91e-f6fd-47bc-bff2-e41e08f53217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.520119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ece91e-f6fd-47bc-bff2-e41e08f53217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:04.526961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ece91e-f6fd-47bc-bff2-e41e08f53217 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:04.558273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1104/2200] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:04.559208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08346e4d-0b90-466c-81c2-4a17894a08ea admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.586194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08346e4d-0b90-466c-81c2-4a17894a08ea admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:04.604471 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0e1e-40fc-46c7-9266-fa3ac51cf9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:04.605201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0e1e-40fc-46c7-9266-fa3ac51cf9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.605512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0e1e-40fc-46c7-9266-fa3ac51cf9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.605790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0e1e-40fc-46c7-9266-fa3ac51cf9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.607149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea0e1e-40fc-46c7-9266-fa3ac51cf9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:04.612773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea0e1e-40fc-46c7-9266-fa3ac51cf9f8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:04.626661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ece91e-f6fd-47bc-bff2-e41e08f53217 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.628746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-19ece91e-f6fd-47bc-bff2-e41e08f53217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:04.640394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1097/2201] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:04.644223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0e1e-40fc-46c7-9266-fa3ac51cf9f8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.656758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ece91e-f6fd-47bc-bff2-e41e08f53217 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:04.667641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0e1e-40fc-46c7-9266-fa3ac51cf9f8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:04.672243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:04.672899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.673238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.673535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] PATH_INFO: `/v3/projects/ce61af557cdf453dabcbb44881448a65` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.674970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce61af557cdf453dabcbb44881448a65)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:04.681234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:04.682022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3b011-5744-4a8b-ae3a-4aa1e52b6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:04.682721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3b011-5744-4a8b-ae3a-4aa1e52b6d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.683215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3b011-5744-4a8b-ae3a-4aa1e52b6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.683397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3b011-5744-4a8b-ae3a-4aa1e52b6d81 admin admin] PATH_INFO: `/v3/projects/d84c6fedd7b0423eba336d6643985684/users/34a23ede3883445ba2744a1660038746/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.707660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3b011-5744-4a8b-ae3a-4aa1e52b6d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84c6fedd7b0423eba336d6643985684, user_id=34a23ede3883445ba2744a1660038746, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:04.714497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3b011-5744-4a8b-ae3a-4aa1e52b6d81 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:04.736237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1098/2202] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:04 2022] PUT /identity/v3/projects/d84c6fedd7b0423eba336d6643985684/users/34a23ede3883445ba2744a1660038746/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:04.756787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae7c30-0cd9-45b3-b792-a350c97f8be4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:04.757079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae7c30-0cd9-45b3-b792-a350c97f8be4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:04.760000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae7c30-0cd9-45b3-b792-a350c97f8be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:04.785655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:04.820089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0fae7c30-0cd9-45b3-b792-a350c97f8be4 None None] MFA Rules not processed for user `34a23ede3883445ba2744a1660038746`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:04.821458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0fae7c30-0cd9-45b3-b792-a350c97f8be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:04.822696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce61af557cdf453dabcbb44881448a65', 'request_id': 'req-02226c52-b706-4014-aad3-a65550a5168f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:04.841397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce61af557cdf453dabcbb44881448a65', 'request_id': 'req-02226c52-b706-4014-aad3-a65550a5168f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:04.853317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce61af557cdf453dabcbb44881448a65', 'request_id': 'req-02226c52-b706-4014-aad3-a65550a5168f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:04.881670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] The token cache is being invalidate because project ce61af557cdf453dabcbb44881448a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:04.886028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:04.889798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:04.891581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1105/2203] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:04 2022] DELETE /identity/v3/projects/ce61af557cdf453dabcbb44881448a65 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:04.895622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.897094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:04.918952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1099/2204] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:04.930925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae7c30-0cd9-45b3-b792-a350c97f8be4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:04.934017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0fae7c30-0cd9-45b3-b792-a350c97f8be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:05.053271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02226c52-b706-4014-aad3-a65550a5168f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:05.063251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:05.064018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:05.064364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:05.064713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] PATH_INFO: `/v3/users/363ac288fc0b43119bbed433866e5fad` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:05.066428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363ac288fc0b43119bbed433866e5fad)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:05.068422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:05.112214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae7c30-0cd9-45b3-b792-a350c97f8be4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:05.136390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818f601-13c8-49cd-8916-a2b4a49c5db1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2ef9088a9941ddb4b163f282a1f7d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:05.137087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818f601-13c8-49cd-8916-a2b4a49c5db1 service glance] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:05.137464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818f601-13c8-49cd-8916-a2b4a49c5db1 service glance] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:05.138042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818f601-13c8-49cd-8916-a2b4a49c5db1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:05.155251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818f601-13c8-49cd-8916-a2b4a49c5db1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:05.157412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818f601-13c8-49cd-8916-a2b4a49c5db1 service glance] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:05.189670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1100/2205] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:05.205293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363ac288fc0b43119bbed433866e5fad'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:05.228162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363ac288fc0b43119bbed433866e5fad'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:05.236805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363ac288fc0b43119bbed433866e5fad'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:05.250796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363ac288fc0b43119bbed433866e5fad'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:05.275263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ea15f80e-fdef-4435-890a-032036ee6104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363ac288fc0b43119bbed433866e5fad'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:05.283730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1106/2206] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:04 2022] DELETE /identity/v3/users/363ac288fc0b43119bbed433866e5fad => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:05.835007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818f601-13c8-49cd-8916-a2b4a49c5db1 service glance] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:05.856897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818f601-13c8-49cd-8916-a2b4a49c5db1 service glance] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:05.909761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:05.946101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:05.947013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:05.947395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:05.947957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] PATH_INFO: `/v3/projects/0f8a4e68eadc406c982d5cce5f9cae39` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:05.949838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f8a4e68eadc406c982d5cce5f9cae39)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:05.952188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:06.010272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f8a4e68eadc406c982d5cce5f9cae39', 'request_id': 'req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.018109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f8a4e68eadc406c982d5cce5f9cae39', 'request_id': 'req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.024610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f8a4e68eadc406c982d5cce5f9cae39', 'request_id': 'req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.037633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] The token cache is being invalidate because project 0f8a4e68eadc406c982d5cce5f9cae39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:06.038015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.038940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.042511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1101/2207] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:05 2022] DELETE /identity/v3/projects/0f8a4e68eadc406c982d5cce5f9cae39 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:06.047219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9ebd-a74f-44c3-85dd-a11663918e79 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.047736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9ebd-a74f-44c3-85dd-a11663918e79 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.047897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9ebd-a74f-44c3-85dd-a11663918e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.070888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-a06c9ebd-a74f-44c3-85dd-a11663918e79 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:06.072137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a06c9ebd-a74f-44c3-85dd-a11663918e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:06.081972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:06.083891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:06.120874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:06.163359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1107/2208] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:06.172457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5583ac-f91e-430a-8754-a58ae0e487d4 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.173693 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5583ac-f91e-430a-8754-a58ae0e487d4 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.174227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5583ac-f91e-430a-8754-a58ae0e487d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.178616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2d1a5-668a-4087-8093-8b23fef0a4bd admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:06.196825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:06.197518 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.197801 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.198077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] PATH_INFO: `/v3/users/a9a6dfc516c84333a2fb393e3f612cf2` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.199361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a6dfc516c84333a2fb393e3f612cf2)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:06.201437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bb5583ac-f91e-430a-8754-a58ae0e487d4 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:06.201597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:06.203055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bb5583ac-f91e-430a-8754-a58ae0e487d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:06.222941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1108/2209] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:06.227759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5583ac-f91e-430a-8754-a58ae0e487d4 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:06.246700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5583ac-f91e-430a-8754-a58ae0e487d4 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:06.253754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa801f2-4754-4ae6-b84b-459d03bcd356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:06.256548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa801f2-4754-4ae6-b84b-459d03bcd356 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.259483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa801f2-4754-4ae6-b84b-459d03bcd356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.259483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa801f2-4754-4ae6-b84b-459d03bcd356 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.260378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa801f2-4754-4ae6-b84b-459d03bcd356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:06.261431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa801f2-4754-4ae6-b84b-459d03bcd356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:06.262795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa801f2-4754-4ae6-b84b-459d03bcd356 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:06.310078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a6dfc516c84333a2fb393e3f612cf2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.312103 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1109/2210] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:37:06.316167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa801f2-4754-4ae6-b84b-459d03bcd356 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:06.319064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a6dfc516c84333a2fb393e3f612cf2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.328903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa801f2-4754-4ae6-b84b-459d03bcd356 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:06.330281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a6dfc516c84333a2fb393e3f612cf2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.331823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a6dfc516c84333a2fb393e3f612cf2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.332633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-05ae51d1-04ef-45a0-aa48-16b142e7ba5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a6dfc516c84333a2fb393e3f612cf2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:06.334523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbc3c7-c108-427c-b85a-29611acba59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:06.335221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbc3c7-c108-427c-b85a-29611acba59c admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.335572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbc3c7-c108-427c-b85a-29611acba59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.335938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbc3c7-c108-427c-b85a-29611acba59c admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.336675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbc3c7-c108-427c-b85a-29611acba59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:06.337469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:06.338988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbc3c7-c108-427c-b85a-29611acba59c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:06.388633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1102/2211] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:06 2022] DELETE /identity/v3/users/a9a6dfc516c84333a2fb393e3f612cf2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:06.393384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba546-a174-4fdb-a899-5ca0ef3f48af None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.394047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba546-a174-4fdb-a899-5ca0ef3f48af None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.394657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ba546-a174-4fdb-a899-5ca0ef3f48af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.411971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1110/2212] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:06 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:06.417008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbc3c7-c108-427c-b85a-29611acba59c admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:06.432705 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-06cbc3c7-c108-427c-b85a-29611acba59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:06.451404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-425ba546-a174-4fdb-a899-5ca0ef3f48af None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:06.452365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-425ba546-a174-4fdb-a899-5ca0ef3f48af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:06.591315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1103/2213] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:06.604286 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbc3c7-c108-427c-b85a-29611acba59c admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:06.610519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48544-21b4-4cfc-9231-ecb8b94e78e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:06.611280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48544-21b4-4cfc-9231-ecb8b94e78e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.612229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48544-21b4-4cfc-9231-ecb8b94e78e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.612229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48544-21b4-4cfc-9231-ecb8b94e78e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.612786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48544-21b4-4cfc-9231-ecb8b94e78e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:06.614874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48544-21b4-4cfc-9231-ecb8b94e78e5 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:06.621786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ba546-a174-4fdb-a899-5ca0ef3f48af None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:06.623732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-425ba546-a174-4fdb-a899-5ca0ef3f48af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:06.672386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1111/2214] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:06 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:06.674014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48544-21b4-4cfc-9231-ecb8b94e78e5 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:06.693521 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48544-21b4-4cfc-9231-ecb8b94e78e5 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:06.701811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985153d-291c-45ba-8868-028f6beced58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:06.702733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985153d-291c-45ba-8868-028f6beced58 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.703233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985153d-291c-45ba-8868-028f6beced58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.703652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985153d-291c-45ba-8868-028f6beced58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.705627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985153d-291c-45ba-8868-028f6beced58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:06.708668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985153d-291c-45ba-8868-028f6beced58 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:06.717410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ba546-a174-4fdb-a899-5ca0ef3f48af None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:06.721423 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036cf13-a2b1-4b83-a24c-a40d79a1bcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:06.722281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036cf13-a2b1-4b83-a24c-a40d79a1bcaf service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.723085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036cf13-a2b1-4b83-a24c-a40d79a1bcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.723464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036cf13-a2b1-4b83-a24c-a40d79a1bcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.730750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1112/2215] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:06.734325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985153d-291c-45ba-8868-028f6beced58 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:06.739082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036cf13-a2b1-4b83-a24c-a40d79a1bcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:06.740758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036cf13-a2b1-4b83-a24c-a40d79a1bcaf service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:06.750246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985153d-291c-45ba-8868-028f6beced58 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:06.753720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1104/2216] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:06.756576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67c87f-646e-4702-8edb-856f2c664c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:06.757206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c87f-646e-4702-8edb-856f2c664c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.757520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c87f-646e-4702-8edb-856f2c664c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.758572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c87f-646e-4702-8edb-856f2c664c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.759276 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67c87f-646e-4702-8edb-856f2c664c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:06.760918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67c87f-646e-4702-8edb-856f2c664c8a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:06.772718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1113/2217] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:06.776962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036cf13-a2b1-4b83-a24c-a40d79a1bcaf service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:06.787789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036cf13-a2b1-4b83-a24c-a40d79a1bcaf service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:06.795082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd0bb1-19cf-4cce-8df5-b986caa02d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:06.795990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd0bb1-19cf-4cce-8df5-b986caa02d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.796366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd0bb1-19cf-4cce-8df5-b986caa02d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.796743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd0bb1-19cf-4cce-8df5-b986caa02d7d admin admin] PATH_INFO: `/v3/projects/b875a5c720874bbe9481b192d04a9c0e/users/c0c1ab2f7a404e5db8a77c16def0bec0/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.824120 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd0bb1-19cf-4cce-8df5-b986caa02d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b875a5c720874bbe9481b192d04a9c0e, user_id=c0c1ab2f7a404e5db8a77c16def0bec0, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:06.828354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd0bb1-19cf-4cce-8df5-b986caa02d7d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:06.859313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1105/2218] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:06 2022] PUT /identity/v3/projects/b875a5c720874bbe9481b192d04a9c0e/users/c0c1ab2f7a404e5db8a77c16def0bec0/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:06.870803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ce476-6877-4773-9f7c-09c5036763d4 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:06.871093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ce476-6877-4773-9f7c-09c5036763d4 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:06.871362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ce476-6877-4773-9f7c-09c5036763d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:06.902760 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2e1ce476-6877-4773-9f7c-09c5036763d4 None None] MFA Rules not processed for user `c0c1ab2f7a404e5db8a77c16def0bec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:06.904060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2e1ce476-6877-4773-9f7c-09c5036763d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:07.002356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:07.027538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1114/2219] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:07.034527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd0bb1-19cf-4cce-8df5-b986caa02d7d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:07.105547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd0bb1-19cf-4cce-8df5-b986caa02d7d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:07.110451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a2f5e-f761-4c98-9c6c-163f20d42692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:07.111070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a2f5e-f761-4c98-9c6c-163f20d42692 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:07.111352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a2f5e-f761-4c98-9c6c-163f20d42692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:07.111626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a2f5e-f761-4c98-9c6c-163f20d42692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:07.112319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a2f5e-f761-4c98-9c6c-163f20d42692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:07.114299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a2f5e-f761-4c98-9c6c-163f20d42692 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:07.119793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:07.138797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ce476-6877-4773-9f7c-09c5036763d4 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:07.141357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2e1ce476-6877-4773-9f7c-09c5036763d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:07.154228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1106/2220] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:07 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:07.155176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a2f5e-f761-4c98-9c6c-163f20d42692 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:07.162911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ce476-6877-4773-9f7c-09c5036763d4 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:07.222595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a2f5e-f761-4c98-9c6c-163f20d42692 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:07.226410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:07.227166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:07.227301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba33a2-f827-498a-bba3-23b35cbb2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:07.227479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:07.227759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] PATH_INFO: `/v3/projects/0809adb38be640f49344bbb04171ceed` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:07.227865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba33a2-f827-498a-bba3-23b35cbb2c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:07.228105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba33a2-f827-498a-bba3-23b35cbb2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:07.228376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba33a2-f827-498a-bba3-23b35cbb2c93 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:07.229033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba33a2-f827-498a-bba3-23b35cbb2c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:07.229139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0809adb38be640f49344bbb04171ceed)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:07.230972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba33a2-f827-498a-bba3-23b35cbb2c93 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:07.231100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:07.260467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1107/2221] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:07 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:07.264718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba33a2-f827-498a-bba3-23b35cbb2c93 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:07.275826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba33a2-f827-498a-bba3-23b35cbb2c93 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:07.288584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0809adb38be640f49344bbb04171ceed', 'request_id': 'req-9d271d3a-d408-42cd-8a31-05be52ff3763'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.296017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0809adb38be640f49344bbb04171ceed', 'request_id': 'req-9d271d3a-d408-42cd-8a31-05be52ff3763'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.301646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0809adb38be640f49344bbb04171ceed', 'request_id': 'req-9d271d3a-d408-42cd-8a31-05be52ff3763'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.314268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] The token cache is being invalidate because project 0809adb38be640f49344bbb04171ceed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:07.314819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.315391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.317017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1115/2222] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:07 2022] DELETE /identity/v3/projects/0809adb38be640f49344bbb04171ceed => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:07.321389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:07.322767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:07.338815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfb40e-97a3-44be-b484-00259bea5373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:07.339353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfb40e-97a3-44be-b484-00259bea5373 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:07.339633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfb40e-97a3-44be-b484-00259bea5373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:07.339940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfb40e-97a3-44be-b484-00259bea5373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:07.340750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfb40e-97a3-44be-b484-00259bea5373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:07.342524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfb40e-97a3-44be-b484-00259bea5373 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:07.362242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1108/2223] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:07.365902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfb40e-97a3-44be-b484-00259bea5373 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:07.370575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3ebfb40e-97a3-44be-b484-00259bea5373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:07.390232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfb40e-97a3-44be-b484-00259bea5373 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:07.395732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457368-d06b-495c-97f0-50b22f2ac97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:07.397384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457368-d06b-495c-97f0-50b22f2ac97f admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:07.397748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457368-d06b-495c-97f0-50b22f2ac97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:07.398098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52457368-d06b-495c-97f0-50b22f2ac97f admin admin] PATH_INFO: `/v3/projects/f59a6236af7948439fcf6e531c74e8e6/users/07c4082835214019a9b141e9333d3239/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:07.401013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271d3a-d408-42cd-8a31-05be52ff3763 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:07.418052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:07.418894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:07.419327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:07.419612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] PATH_INFO: `/v3/users/95fe02fc90aa4ad1a6e5dab6c8425c39` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:07.420967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fe02fc90aa4ad1a6e5dab6c8425c39)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:07.423611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:07.430118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52457368-d06b-495c-97f0-50b22f2ac97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59a6236af7948439fcf6e531c74e8e6, user_id=07c4082835214019a9b141e9333d3239, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:07.432919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52457368-d06b-495c-97f0-50b22f2ac97f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:07.454541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1109/2224] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:07 2022] PUT /identity/v3/projects/f59a6236af7948439fcf6e531c74e8e6/users/07c4082835214019a9b141e9333d3239/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:07.458439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457368-d06b-495c-97f0-50b22f2ac97f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:07.473095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:07.522471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fe02fc90aa4ad1a6e5dab6c8425c39'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.529877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:07.541552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fe02fc90aa4ad1a6e5dab6c8425c39'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.551042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52457368-d06b-495c-97f0-50b22f2ac97f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:07.556110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fe02fc90aa4ad1a6e5dab6c8425c39'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.556894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fe02fc90aa4ad1a6e5dab6c8425c39'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.565312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9a6c6-bcf0-4b79-aa7b-19d3f529f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:07.566384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a6c6-bcf0-4b79-aa7b-19d3f529f6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:07.566663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a6c6-bcf0-4b79-aa7b-19d3f529f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:07.566950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a6c6-bcf0-4b79-aa7b-19d3f529f6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:07.567916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9a6c6-bcf0-4b79-aa7b-19d3f529f6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:07.577385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9a6c6-bcf0-4b79-aa7b-19d3f529f6c0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:07.584344 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fe02fc90aa4ad1a6e5dab6c8425c39'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:07.600361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1116/2225] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:07 2022] DELETE /identity/v3/users/95fe02fc90aa4ad1a6e5dab6c8425c39 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:07.602269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1110/2226] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:07.606046 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:07.607614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:07.686329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570db0a-7bd0-4588-80fc-9751784dd6f9 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:07.692872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2005-0668-47d5-8d3c-02609263151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:07.694434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2005-0668-47d5-8d3c-02609263151b admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:07.694878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2005-0668-47d5-8d3c-02609263151b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:07.695868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2005-0668-47d5-8d3c-02609263151b admin admin] PATH_INFO: `/v3/projects/f59a6236af7948439fcf6e531c74e8e6/users/07c4082835214019a9b141e9333d3239/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:07.698443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c2005-0668-47d5-8d3c-02609263151b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59a6236af7948439fcf6e531c74e8e6, user_id=07c4082835214019a9b141e9333d3239, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:07.703500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c2005-0668-47d5-8d3c-02609263151b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:07.716911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1117/2227] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:07 2022] PUT /identity/v3/projects/f59a6236af7948439fcf6e531c74e8e6/users/07c4082835214019a9b141e9333d3239/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:07.728429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b168c-a60e-436e-b85b-4bfa19eaee5b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:07.728759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b168c-a60e-436e-b85b-4bfa19eaee5b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:07.729042 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b168c-a60e-436e-b85b-4bfa19eaee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:07.780556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c24b168c-a60e-436e-b85b-4bfa19eaee5b None None] MFA Rules not processed for user `07c4082835214019a9b141e9333d3239`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:07.786890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c24b168c-a60e-436e-b85b-4bfa19eaee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:07.906954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1111/2228] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:07.918910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2005-0668-47d5-8d3c-02609263151b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:07.920963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-796c2005-0668-47d5-8d3c-02609263151b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:08.066607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2005-0668-47d5-8d3c-02609263151b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:08.073414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c45c29-8b0f-4cb9-acd3-c8156014e1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:08.074776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c45c29-8b0f-4cb9-acd3-c8156014e1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:08.075411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c45c29-8b0f-4cb9-acd3-c8156014e1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:08.076023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c45c29-8b0f-4cb9-acd3-c8156014e1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:08.095224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c45c29-8b0f-4cb9-acd3-c8156014e1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:08.098211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c45c29-8b0f-4cb9-acd3-c8156014e1e7 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:08.120497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1118/2229] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:08.436751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b168c-a60e-436e-b85b-4bfa19eaee5b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:08.450349 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c24b168c-a60e-436e-b85b-4bfa19eaee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:08.536381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b168c-a60e-436e-b85b-4bfa19eaee5b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:08.541730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:08.542385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:08.542659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:08.542941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] PATH_INFO: `/v3/projects/4edf6f33a55d430ebd531b19e4ab5bfe` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:08.544139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edf6f33a55d430ebd531b19e4ab5bfe)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:08.549439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:08.622638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edf6f33a55d430ebd531b19e4ab5bfe', 'request_id': 'req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.628783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c45c29-8b0f-4cb9-acd3-c8156014e1e7 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:08.634776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edf6f33a55d430ebd531b19e4ab5bfe', 'request_id': 'req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.640937 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c45c29-8b0f-4cb9-acd3-c8156014e1e7 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:08.644053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edf6f33a55d430ebd531b19e4ab5bfe', 'request_id': 'req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.654857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:08.659194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] The token cache is being invalidate because project 4edf6f33a55d430ebd531b19e4ab5bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:08.660280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.661651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aa52b5e-dd41-40e5-899c-f7b2853c7c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.668663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1112/2230] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:08 2022] DELETE /identity/v3/projects/4edf6f33a55d430ebd531b19e4ab5bfe => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:08.670863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47be2b-f19a-4817-bc21-946b6eaabe54 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:08.671618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47be2b-f19a-4817-bc21-946b6eaabe54 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:08.672222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47be2b-f19a-4817-bc21-946b6eaabe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:08.697976 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:08.710814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8b47be2b-f19a-4817-bc21-946b6eaabe54 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:08.712595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8b47be2b-f19a-4817-bc21-946b6eaabe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:08.724738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:08.725550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:08.725900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:08.726257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] PATH_INFO: `/v3/users/c0c1ab2f7a404e5db8a77c16def0bec0` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:08.728036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c1ab2f7a404e5db8a77c16def0bec0)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:08.730121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:08.792114 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1113/2231] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:08.794100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c1ab2f7a404e5db8a77c16def0bec0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.800290 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6b630-faf8-4224-8360-2efcedbb699f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:08.800819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6b630-faf8-4224-8360-2efcedbb699f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:08.801137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6b630-faf8-4224-8360-2efcedbb699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:08.802935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c1ab2f7a404e5db8a77c16def0bec0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.811861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c1ab2f7a404e5db8a77c16def0bec0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.813130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c1ab2f7a404e5db8a77c16def0bec0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.827373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-96b6b630-faf8-4224-8360-2efcedbb699f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:08.828691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6ede82c9-64a3-4a70-b40a-413d48c0f407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c1ab2f7a404e5db8a77c16def0bec0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:08.828879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-96b6b630-faf8-4224-8360-2efcedbb699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:08.843130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1119/2232] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:08 2022] DELETE /identity/v3/users/c0c1ab2f7a404e5db8a77c16def0bec0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:08.844747 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1114/2233] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:08.846138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde7194-3e84-45ab-9d47-2e0a59d350f5 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:08.846271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6b630-faf8-4224-8360-2efcedbb699f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:08.846759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde7194-3e84-45ab-9d47-2e0a59d350f5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:08.847345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde7194-3e84-45ab-9d47-2e0a59d350f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:08.859235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6b630-faf8-4224-8360-2efcedbb699f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:08.871048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-0dde7194-3e84-45ab-9d47-2e0a59d350f5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:08.872849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0dde7194-3e84-45ab-9d47-2e0a59d350f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:08.933921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da993c7-3d5b-41c1-88ef-7b7e8e07edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:08.934624 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da993c7-3d5b-41c1-88ef-7b7e8e07edb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:08.934913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da993c7-3d5b-41c1-88ef-7b7e8e07edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:08.935199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da993c7-3d5b-41c1-88ef-7b7e8e07edb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:08.936487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da993c7-3d5b-41c1-88ef-7b7e8e07edb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:08.936806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da993c7-3d5b-41c1-88ef-7b7e8e07edb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:08.939461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da993c7-3d5b-41c1-88ef-7b7e8e07edb0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:08.956327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1115/2234] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:08.961942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da993c7-3d5b-41c1-88ef-7b7e8e07edb0 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:08.972617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da993c7-3d5b-41c1-88ef-7b7e8e07edb0 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:08.977047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1120/2235] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:08.981307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae25b43-53ff-42af-b966-fa51ddca302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:08.981996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae25b43-53ff-42af-b966-fa51ddca302c admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:08.982278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae25b43-53ff-42af-b966-fa51ddca302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:08.982694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae25b43-53ff-42af-b966-fa51ddca302c admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:08.983372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae25b43-53ff-42af-b966-fa51ddca302c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:08.985603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae25b43-53ff-42af-b966-fa51ddca302c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.006862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde7194-3e84-45ab-9d47-2e0a59d350f5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.012421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0dde7194-3e84-45ab-9d47-2e0a59d350f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:09.085026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1116/2236] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:08 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:09.086727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae25b43-53ff-42af-b966-fa51ddca302c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.134882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde7194-3e84-45ab-9d47-2e0a59d350f5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.170151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:09.225289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae25b43-53ff-42af-b966-fa51ddca302c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.235913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43572858-9e19-4985-90b0-f703985d3bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.236686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43572858-9e19-4985-90b0-f703985d3bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.237532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43572858-9e19-4985-90b0-f703985d3bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.237956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43572858-9e19-4985-90b0-f703985d3bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.238755 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43572858-9e19-4985-90b0-f703985d3bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.241764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43572858-9e19-4985-90b0-f703985d3bb7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.250086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124100c8-480c-4560-94d7-26cb88404e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.250869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124100c8-480c-4560-94d7-26cb88404e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.251223 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124100c8-480c-4560-94d7-26cb88404e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.251631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124100c8-480c-4560-94d7-26cb88404e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.268990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124100c8-480c-4560-94d7-26cb88404e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.269410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:09.270923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124100c8-480c-4560-94d7-26cb88404e2a service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.285899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1121/2237] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:09.292452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1117/2238] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:09 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:09.293552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124100c8-480c-4560-94d7-26cb88404e2a service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.303641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124100c8-480c-4560-94d7-26cb88404e2a service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.311845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f5df6-181d-4246-9a3c-93c46c97f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.312525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f5df6-181d-4246-9a3c-93c46c97f21a admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.312809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f5df6-181d-4246-9a3c-93c46c97f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.313082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f5df6-181d-4246-9a3c-93c46c97f21a admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.313816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f5df6-181d-4246-9a3c-93c46c97f21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.315481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f5df6-181d-4246-9a3c-93c46c97f21a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.326496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1122/2239] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:09.330741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43572858-9e19-4985-90b0-f703985d3bb7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.344305 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43572858-9e19-4985-90b0-f703985d3bb7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.352066 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb788ee-d27b-4faf-8534-719c1452f762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.352373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb788ee-d27b-4faf-8534-719c1452f762 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.352733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb788ee-d27b-4faf-8534-719c1452f762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.353299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb788ee-d27b-4faf-8534-719c1452f762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.354006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb788ee-d27b-4faf-8534-719c1452f762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.355722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb788ee-d27b-4faf-8534-719c1452f762 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.372512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1118/2240] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:09.375181 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f5df6-181d-4246-9a3c-93c46c97f21a admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.390225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f5df6-181d-4246-9a3c-93c46c97f21a admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.397452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df664e-7590-4ba6-ae99-801f0fdce531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.398326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df664e-7590-4ba6-ae99-801f0fdce531 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.399774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df664e-7590-4ba6-ae99-801f0fdce531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.400110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df664e-7590-4ba6-ae99-801f0fdce531 admin admin] PATH_INFO: `/v3/projects/7d26eb79b9a442aaabe6d8c79d4ae12a/users/46701e9d6ec44e8eb3efac2744fe4a7f/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.445006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df664e-7590-4ba6-ae99-801f0fdce531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d26eb79b9a442aaabe6d8c79d4ae12a, user_id=46701e9d6ec44e8eb3efac2744fe4a7f, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.455861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df664e-7590-4ba6-ae99-801f0fdce531 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.493798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1123/2241] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:09 2022] PUT /identity/v3/projects/7d26eb79b9a442aaabe6d8c79d4ae12a/users/46701e9d6ec44e8eb3efac2744fe4a7f/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:09.496402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e5305-c6f2-4e09-a570-bd802e91102b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.496856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e5305-c6f2-4e09-a570-bd802e91102b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.496958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e5305-c6f2-4e09-a570-bd802e91102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.531716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-064e5305-c6f2-4e09-a570-bd802e91102b None None] MFA Rules not processed for user `46701e9d6ec44e8eb3efac2744fe4a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:09.533022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-064e5305-c6f2-4e09-a570-bd802e91102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:09.625941 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1119/2242] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:09.630368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df664e-7590-4ba6-ae99-801f0fdce531 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.702629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df664e-7590-4ba6-ae99-801f0fdce531 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.707960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba977545-9a11-4581-a848-3d6364e8bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.708902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977545-9a11-4581-a848-3d6364e8bec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.709347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977545-9a11-4581-a848-3d6364e8bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.709785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977545-9a11-4581-a848-3d6364e8bec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.710612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba977545-9a11-4581-a848-3d6364e8bec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.713096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba977545-9a11-4581-a848-3d6364e8bec2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.743955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1124/2243] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:09 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:09.748126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e5305-c6f2-4e09-a570-bd802e91102b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.760061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e5305-c6f2-4e09-a570-bd802e91102b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.823329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a06f-3574-4bf1-bf85-41a6833de31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.823518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba977545-9a11-4581-a848-3d6364e8bec2 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.824143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a06f-3574-4bf1-bf85-41a6833de31e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.824517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a06f-3574-4bf1-bf85-41a6833de31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.825090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a06f-3574-4bf1-bf85-41a6833de31e admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.825586 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ba977545-9a11-4581-a848-3d6364e8bec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:09.825716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3a06f-3574-4bf1-bf85-41a6833de31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.827518 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3a06f-3574-4bf1-bf85-41a6833de31e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.839909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba977545-9a11-4581-a848-3d6364e8bec2 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.846822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.847469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.847740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.848053 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] PATH_INFO: `/v3/projects/b875a5c720874bbe9481b192d04a9c0e` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.849379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b875a5c720874bbe9481b192d04a9c0e)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.851293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.858690 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1120/2244] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:09 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:09.860217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a06f-3574-4bf1-bf85-41a6833de31e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.879487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a06f-3574-4bf1-bf85-41a6833de31e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.887211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65087c-11e8-476e-b7b8-3ad9c553582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.887842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65087c-11e8-476e-b7b8-3ad9c553582e admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.888266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65087c-11e8-476e-b7b8-3ad9c553582e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.888583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65087c-11e8-476e-b7b8-3ad9c553582e admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.889322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65087c-11e8-476e-b7b8-3ad9c553582e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.890973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65087c-11e8-476e-b7b8-3ad9c553582e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:09.905124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1121/2245] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:09.906247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65087c-11e8-476e-b7b8-3ad9c553582e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.907232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b875a5c720874bbe9481b192d04a9c0e', 'request_id': 'req-8edb5a1f-2dcc-438e-bba0-78fba349bff6'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.915529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b875a5c720874bbe9481b192d04a9c0e', 'request_id': 'req-8edb5a1f-2dcc-438e-bba0-78fba349bff6'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.916427 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65087c-11e8-476e-b7b8-3ad9c553582e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:09.921360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b875a5c720874bbe9481b192d04a9c0e', 'request_id': 'req-8edb5a1f-2dcc-438e-bba0-78fba349bff6'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.922462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:09.936367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] The token cache is being invalidate because project b875a5c720874bbe9481b192d04a9c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:09.936663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.937546 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:09.939131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1125/2246] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:09 2022] DELETE /identity/v3/projects/b875a5c720874bbe9481b192d04a9c0e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:09.942946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:09.944374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:09.966462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:09.979584 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b2390-741a-4ade-840e-3c06c7dce422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:09.980267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2390-741a-4ade-840e-3c06c7dce422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:09.980545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2390-741a-4ade-840e-3c06c7dce422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:09.980818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2390-741a-4ade-840e-3c06c7dce422 admin admin] PATH_INFO: `/v3/projects/be000bc98ff048b19892c5561c38d3ca/users/7e1f53e9965a43a5aaf9c39b94918d6c/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:09.995710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b2390-741a-4ade-840e-3c06c7dce422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be000bc98ff048b19892c5561c38d3ca, user_id=7e1f53e9965a43a5aaf9c39b94918d6c, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:09.998486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b2390-741a-4ade-840e-3c06c7dce422 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:10.012051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1122/2247] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:09 2022] PUT /identity/v3/projects/be000bc98ff048b19892c5561c38d3ca/users/7e1f53e9965a43a5aaf9c39b94918d6c/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:10.012224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb5a1f-2dcc-438e-bba0-78fba349bff6 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:10.015950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b2390-741a-4ade-840e-3c06c7dce422 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:10.018087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4b1b2390-741a-4ade-840e-3c06c7dce422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:10.098446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:10.099483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:10.099916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:10.100354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] PATH_INFO: `/v3/users/07c4082835214019a9b141e9333d3239` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:10.100853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b2390-741a-4ade-840e-3c06c7dce422 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:10.106464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c4082835214019a9b141e9333d3239)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:10.106912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f745ec3-cae3-4259-bf83-8c17c3f919c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:10.107532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f745ec3-cae3-4259-bf83-8c17c3f919c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:10.107819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f745ec3-cae3-4259-bf83-8c17c3f919c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:10.108091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f745ec3-cae3-4259-bf83-8c17c3f919c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:10.108783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f745ec3-cae3-4259-bf83-8c17c3f919c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:10.110408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f745ec3-cae3-4259-bf83-8c17c3f919c7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:10.110759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:10.123329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1123/2248] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:10.127540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f745ec3-cae3-4259-bf83-8c17c3f919c7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:10.138794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f745ec3-cae3-4259-bf83-8c17c3f919c7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:10.143767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09152ff-8b97-4081-a30c-adfec1020500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:10.144611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09152ff-8b97-4081-a30c-adfec1020500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:10.144997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09152ff-8b97-4081-a30c-adfec1020500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:10.145199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09152ff-8b97-4081-a30c-adfec1020500 admin admin] PATH_INFO: `/v3/projects/be000bc98ff048b19892c5561c38d3ca/users/7e1f53e9965a43a5aaf9c39b94918d6c/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:10.147771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09152ff-8b97-4081-a30c-adfec1020500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be000bc98ff048b19892c5561c38d3ca, user_id=7e1f53e9965a43a5aaf9c39b94918d6c, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:10.151791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09152ff-8b97-4081-a30c-adfec1020500 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:10.174771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1124/2249] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:10 2022] PUT /identity/v3/projects/be000bc98ff048b19892c5561c38d3ca/users/7e1f53e9965a43a5aaf9c39b94918d6c/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:10.176261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3858-4e60-465f-93f0-a7b40484374c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:10.176549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3858-4e60-465f-93f0-a7b40484374c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:10.176926 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3858-4e60-465f-93f0-a7b40484374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:10.202572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c4082835214019a9b141e9333d3239'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.209865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5ffc3858-4e60-465f-93f0-a7b40484374c None None] MFA Rules not processed for user `7e1f53e9965a43a5aaf9c39b94918d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:10.211182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5ffc3858-4e60-465f-93f0-a7b40484374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:10.214430 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c4082835214019a9b141e9333d3239'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.223766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c4082835214019a9b141e9333d3239'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.225733 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c4082835214019a9b141e9333d3239'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.249533 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c4082835214019a9b141e9333d3239'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:10.261875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1126/2250] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:09 2022] DELETE /identity/v3/users/07c4082835214019a9b141e9333d3239 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:10.306377 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1125/2251] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:10.317225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:10.318740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:10.354382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:10.395403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386dccb-087d-4fb5-a9a6-903fc6582a6b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:10.399339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9e695-1ce4-4346-b196-397ca2a7c01b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:10.400084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e695-1ce4-4346-b196-397ca2a7c01b service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:10.400236 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e695-1ce4-4346-b196-397ca2a7c01b service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:10.400513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e695-1ce4-4346-b196-397ca2a7c01b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:10.492578 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9e695-1ce4-4346-b196-397ca2a7c01b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:10.496015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9e695-1ce4-4346-b196-397ca2a7c01b service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:10.509485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1127/2252] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:10.668080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc3858-4e60-465f-93f0-a7b40484374c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:10.796797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9e695-1ce4-4346-b196-397ca2a7c01b service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:10.798419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-33e9e695-1ce4-4346-b196-397ca2a7c01b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:10.810106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:10.828330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc3858-4e60-465f-93f0-a7b40484374c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:10.833681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f2726-d060-4a9f-abab-9bdb977eccfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:10.834318 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2726-d060-4a9f-abab-9bdb977eccfe service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:10.834643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2726-d060-4a9f-abab-9bdb977eccfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:10.836419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2726-d060-4a9f-abab-9bdb977eccfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:10.839465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-aa5f2726-d060-4a9f-abab-9bdb977eccfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:10.958664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2726-d060-4a9f-abab-9bdb977eccfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:10.961032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2726-d060-4a9f-abab-9bdb977eccfe service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:10.978014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9e695-1ce4-4346-b196-397ca2a7c01b service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:10.983830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1126/2253] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:10.997385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:10.998986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:10.999432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:10.999645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] PATH_INFO: `/v3/projects/f59a6236af7948439fcf6e531c74e8e6` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.001377 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59a6236af7948439fcf6e531c74e8e6)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:11.003267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.087526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59a6236af7948439fcf6e531c74e8e6', 'request_id': 'req-dde2f4cc-6ba8-4189-b26d-257867fce45d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.110215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59a6236af7948439fcf6e531c74e8e6', 'request_id': 'req-dde2f4cc-6ba8-4189-b26d-257867fce45d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.117057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59a6236af7948439fcf6e531c74e8e6', 'request_id': 'req-dde2f4cc-6ba8-4189-b26d-257867fce45d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.128874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:11.134715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] The token cache is being invalidate because project f59a6236af7948439fcf6e531c74e8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:11.135406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.136595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-dde2f4cc-6ba8-4189-b26d-257867fce45d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:11.153622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1128/2254] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:10 2022] DELETE /identity/v3/projects/f59a6236af7948439fcf6e531c74e8e6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:11.155680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91934d-2613-4585-b4f8-139c01e9b0d6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.155997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91934d-2613-4585-b4f8-139c01e9b0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.156275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91934d-2613-4585-b4f8-139c01e9b0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.183161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1a91934d-2613-4585-b4f8-139c01e9b0d6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:11.184422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1a91934d-2613-4585-b4f8-139c01e9b0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:11.266178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1127/2255] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:11.274685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17a1c-408b-472c-bbea-56d8bcf460d0 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.274975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17a1c-408b-472c-bbea-56d8bcf460d0 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.275279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17a1c-408b-472c-bbea-56d8bcf460d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.298790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4fa17a1c-408b-472c-bbea-56d8bcf460d0 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:11.300171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4fa17a1c-408b-472c-bbea-56d8bcf460d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:11.309146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1129/2256] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:11.313590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91934d-2613-4585-b4f8-139c01e9b0d6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:11.323461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91934d-2613-4585-b4f8-139c01e9b0d6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:11.328117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9087e-c745-4557-8425-15b53bec7a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:11.328738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9087e-c745-4557-8425-15b53bec7a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.329408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9087e-c745-4557-8425-15b53bec7a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.329408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9087e-c745-4557-8425-15b53bec7a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.329996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9087e-c745-4557-8425-15b53bec7a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:11.330339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9087e-c745-4557-8425-15b53bec7a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:11.331935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9087e-c745-4557-8425-15b53bec7a38 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.348146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1128/2257] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:11.353067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa17a1c-408b-472c-bbea-56d8bcf460d0 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:11.364114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa17a1c-408b-472c-bbea-56d8bcf460d0 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:11.370047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79a8d-d9fb-46c6-b929-f420498d6e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:11.370699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79a8d-d9fb-46c6-b929-f420498d6e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.370982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79a8d-d9fb-46c6-b929-f420498d6e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.371256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79a8d-d9fb-46c6-b929-f420498d6e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.371947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79a8d-d9fb-46c6-b929-f420498d6e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:11.373876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79a8d-d9fb-46c6-b929-f420498d6e26 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.405628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1130/2258] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:11 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:11.410656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9087e-c745-4557-8425-15b53bec7a38 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:11.422852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9087e-c745-4557-8425-15b53bec7a38 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:11.482821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8ea47-1b68-49f3-8121-23301ed3c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:11.483436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ea47-1b68-49f3-8121-23301ed3c509 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.483721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ea47-1b68-49f3-8121-23301ed3c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.484001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ea47-1b68-49f3-8121-23301ed3c509 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.484661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8ea47-1b68-49f3-8121-23301ed3c509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:11.486614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8ea47-1b68-49f3-8121-23301ed3c509 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.507396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1129/2259] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:11 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:11.511942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79a8d-d9fb-46c6-b929-f420498d6e26 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:11.522643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79a8d-d9fb-46c6-b929-f420498d6e26 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:11.527983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd48a8-ea91-479f-9b8e-a2ff0f0865c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:11.528606 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd48a8-ea91-479f-9b8e-a2ff0f0865c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.528872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd48a8-ea91-479f-9b8e-a2ff0f0865c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.529148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd48a8-ea91-479f-9b8e-a2ff0f0865c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.529885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd48a8-ea91-479f-9b8e-a2ff0f0865c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:11.531462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd48a8-ea91-479f-9b8e-a2ff0f0865c7 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.541475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1131/2260] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:11.545632 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8ea47-1b68-49f3-8121-23301ed3c509 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:11.556778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8ea47-1b68-49f3-8121-23301ed3c509 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:11.561437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b2d7-ef07-4fca-ac83-e0adebc1e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:11.562047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b2d7-ef07-4fca-ac83-e0adebc1e9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.562327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b2d7-ef07-4fca-ac83-e0adebc1e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.562604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b2d7-ef07-4fca-ac83-e0adebc1e9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.563307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4b2d7-ef07-4fca-ac83-e0adebc1e9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:11.564905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4b2d7-ef07-4fca-ac83-e0adebc1e9fa admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.576626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1130/2261] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:11.581117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd48a8-ea91-479f-9b8e-a2ff0f0865c7 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:11.591853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd48a8-ea91-479f-9b8e-a2ff0f0865c7 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:11.596401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ae4cd-b979-478d-9a81-0660e40ccfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:11.597049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ae4cd-b979-478d-9a81-0660e40ccfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.597355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ae4cd-b979-478d-9a81-0660e40ccfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.597624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ae4cd-b979-478d-9a81-0660e40ccfa9 admin admin] PATH_INFO: `/v3/projects/4e6e3bbe55a44f599b7cd3a29de99a5a/users/4aa6b823e24945f2af87059b1b203641/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.612208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ae4cd-b979-478d-9a81-0660e40ccfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6e3bbe55a44f599b7cd3a29de99a5a, user_id=4aa6b823e24945f2af87059b1b203641, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:11.614860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ae4cd-b979-478d-9a81-0660e40ccfa9 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.628510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1132/2262] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:11 2022] PUT /identity/v3/projects/4e6e3bbe55a44f599b7cd3a29de99a5a/users/4aa6b823e24945f2af87059b1b203641/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:11.639998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789d196-7cda-49b4-8376-269e7bc43e81 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.640311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789d196-7cda-49b4-8376-269e7bc43e81 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.640588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789d196-7cda-49b4-8376-269e7bc43e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.649175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:11.669536 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5789d196-7cda-49b4-8376-269e7bc43e81 None None] MFA Rules not processed for user `4aa6b823e24945f2af87059b1b203641`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:11.670675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5789d196-7cda-49b4-8376-269e7bc43e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:11.735048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1131/2263] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:11.739844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ae4cd-b979-478d-9a81-0660e40ccfa9 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:11.807366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ae4cd-b979-478d-9a81-0660e40ccfa9 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:11.812572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4318d-7679-433b-a3a1-595dc092c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:11.813191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4318d-7679-433b-a3a1-595dc092c5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.813504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4318d-7679-433b-a3a1-595dc092c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.813778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4318d-7679-433b-a3a1-595dc092c5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.814471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4318d-7679-433b-a3a1-595dc092c5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:11.816359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4318d-7679-433b-a3a1-595dc092c5c7 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.848802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1133/2264] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:11 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:11.850043 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789d196-7cda-49b4-8376-269e7bc43e81 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:11.860769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789d196-7cda-49b4-8376-269e7bc43e81 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:11.950194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6775c8-83fe-4558-b7c7-7d4c0c67765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:11.950832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6775c8-83fe-4558-b7c7-7d4c0c67765e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:11.951117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6775c8-83fe-4558-b7c7-7d4c0c67765e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:11.951396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6775c8-83fe-4558-b7c7-7d4c0c67765e admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:11.952210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6775c8-83fe-4558-b7c7-7d4c0c67765e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:11.955187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6775c8-83fe-4558-b7c7-7d4c0c67765e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:11.991150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1132/2265] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:11 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:11.996412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4318d-7679-433b-a3a1-595dc092c5c7 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:12.008685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4318d-7679-433b-a3a1-595dc092c5c7 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:12.013631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930b6a7-3078-45ad-b994-9f16cb028b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:12.014386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930b6a7-3078-45ad-b994-9f16cb028b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.014774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930b6a7-3078-45ad-b994-9f16cb028b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.015142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930b6a7-3078-45ad-b994-9f16cb028b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.015943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930b6a7-3078-45ad-b994-9f16cb028b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:12.017686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930b6a7-3078-45ad-b994-9f16cb028b26 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:12.029356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1134/2266] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:12.033117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6775c8-83fe-4558-b7c7-7d4c0c67765e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:12.044249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6775c8-83fe-4558-b7c7-7d4c0c67765e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:12.049238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225af5d4-5278-4e3b-8a40-6f932ba4ad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:12.050110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af5d4-5278-4e3b-8a40-6f932ba4ad00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.050487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af5d4-5278-4e3b-8a40-6f932ba4ad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.050858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af5d4-5278-4e3b-8a40-6f932ba4ad00 admin admin] PATH_INFO: `/v3/projects/22709e07de814fc786e28e98179eb944/users/59fc790b99584741a5594e36e64c3058/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.068615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225af5d4-5278-4e3b-8a40-6f932ba4ad00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22709e07de814fc786e28e98179eb944, user_id=59fc790b99584741a5594e36e64c3058, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:12.072004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225af5d4-5278-4e3b-8a40-6f932ba4ad00 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:12.090463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1133/2267] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:12 2022] PUT /identity/v3/projects/22709e07de814fc786e28e98179eb944/users/59fc790b99584741a5594e36e64c3058/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:12.094729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930b6a7-3078-45ad-b994-9f16cb028b26 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:12.109173 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930b6a7-3078-45ad-b994-9f16cb028b26 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:12.177894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0630d-1abc-496c-bfb5-819b5cf58428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:12.178547 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0630d-1abc-496c-bfb5-819b5cf58428 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.178892 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0630d-1abc-496c-bfb5-819b5cf58428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.179231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0630d-1abc-496c-bfb5-819b5cf58428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.180503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0630d-1abc-496c-bfb5-819b5cf58428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:12.182292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0630d-1abc-496c-bfb5-819b5cf58428 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:12.193366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1135/2268] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:12.197957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225af5d4-5278-4e3b-8a40-6f932ba4ad00 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:12.211221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225af5d4-5278-4e3b-8a40-6f932ba4ad00 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:12.217577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3177de-d5b2-454a-b8e6-ae39413336be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:12.218321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3177de-d5b2-454a-b8e6-ae39413336be admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.218664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3177de-d5b2-454a-b8e6-ae39413336be admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.219003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3177de-d5b2-454a-b8e6-ae39413336be admin admin] PATH_INFO: `/v3/projects/22709e07de814fc786e28e98179eb944/users/59fc790b99584741a5594e36e64c3058/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.221022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3177de-d5b2-454a-b8e6-ae39413336be admin admin] RBAC: Authorizing `identity:create_grant(project_id=22709e07de814fc786e28e98179eb944, user_id=59fc790b99584741a5594e36e64c3058, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:12.223983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3177de-d5b2-454a-b8e6-ae39413336be admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:12.236020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1134/2269] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:12 2022] PUT /identity/v3/projects/22709e07de814fc786e28e98179eb944/users/59fc790b99584741a5594e36e64c3058/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:12.248620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaafd5-be22-4b81-b17d-a6a1f6c16477 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.249016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaafd5-be22-4b81-b17d-a6a1f6c16477 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.249407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaafd5-be22-4b81-b17d-a6a1f6c16477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.266450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:12.290229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4ecaafd5-be22-4b81-b17d-a6a1f6c16477 None None] MFA Rules not processed for user `59fc790b99584741a5594e36e64c3058`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:12.291674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4ecaafd5-be22-4b81-b17d-a6a1f6c16477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:12.421127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1136/2270] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:12.437785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3177de-d5b2-454a-b8e6-ae39413336be admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:12.439697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cf3177de-d5b2-454a-b8e6-ae39413336be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:12.533099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:12.540479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3177de-d5b2-454a-b8e6-ae39413336be admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:12.548100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972660e-30c1-47b2-ae94-a30195c13ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:12.550343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972660e-30c1-47b2-ae94-a30195c13ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:12.553867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972660e-30c1-47b2-ae94-a30195c13ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:12.553867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972660e-30c1-47b2-ae94-a30195c13ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:12.645157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972660e-30c1-47b2-ae94-a30195c13ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:12.646713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972660e-30c1-47b2-ae94-a30195c13ec9 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:12.657516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1135/2271] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:13.797903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaafd5-be22-4b81-b17d-a6a1f6c16477 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:13.799415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4ecaafd5-be22-4b81-b17d-a6a1f6c16477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:13.863496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaafd5-be22-4b81-b17d-a6a1f6c16477 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:13.868029 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:13.868660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:13.868938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:13.869209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] PATH_INFO: `/v3/users/46701e9d6ec44e8eb3efac2744fe4a7f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:13.870390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46701e9d6ec44e8eb3efac2744fe4a7f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:13.872317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:13.919052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46701e9d6ec44e8eb3efac2744fe4a7f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:13.925754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46701e9d6ec44e8eb3efac2744fe4a7f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:13.933528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46701e9d6ec44e8eb3efac2744fe4a7f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:13.934368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46701e9d6ec44e8eb3efac2744fe4a7f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:13.948425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46701e9d6ec44e8eb3efac2744fe4a7f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:13.954397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1137/2272] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:13 2022] DELETE /identity/v3/users/46701e9d6ec44e8eb3efac2744fe4a7f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:13.958999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb7f6e-73e0-489d-be98-376fdff695a8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:13.959487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb7f6e-73e0-489d-be98-376fdff695a8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:13.959601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb7f6e-73e0-489d-be98-376fdff695a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:13.979146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-63fb7f6e-73e0-489d-be98-376fdff695a8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:13.980355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-63fb7f6e-73e0-489d-be98-376fdff695a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:14.063793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1136/2273] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:14.074559 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:14.076497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:14.095028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:14.152328 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb815d-faaf-4ba6-8c7e-66790691d9a3 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:14.157373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506e7d8-4361-4ecf-b153-c1b5c0c7ae0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:14.158441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506e7d8-4361-4ecf-b153-c1b5c0c7ae0f service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.158441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506e7d8-4361-4ecf-b153-c1b5c0c7ae0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.158654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506e7d8-4361-4ecf-b153-c1b5c0c7ae0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.173918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506e7d8-4361-4ecf-b153-c1b5c0c7ae0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:14.175814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506e7d8-4361-4ecf-b153-c1b5c0c7ae0f service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:14.187955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1138/2274] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:14.643196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb7f6e-73e0-489d-be98-376fdff695a8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:14.649608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-63fb7f6e-73e0-489d-be98-376fdff695a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:14.676915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb7f6e-73e0-489d-be98-376fdff695a8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:14.695560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:14.696256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.696491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.696759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] PATH_INFO: `/v3/projects/7d26eb79b9a442aaabe6d8c79d4ae12a` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.698077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d26eb79b9a442aaabe6d8c79d4ae12a)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:14.699824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:14.759200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d26eb79b9a442aaabe6d8c79d4ae12a', 'request_id': 'req-a368632c-e573-4178-ac75-1d470a7db47c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:14.769086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d26eb79b9a442aaabe6d8c79d4ae12a', 'request_id': 'req-a368632c-e573-4178-ac75-1d470a7db47c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:14.776065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d26eb79b9a442aaabe6d8c79d4ae12a', 'request_id': 'req-a368632c-e573-4178-ac75-1d470a7db47c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:14.790023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] The token cache is being invalidate because project 7d26eb79b9a442aaabe6d8c79d4ae12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:14.790520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:14.791303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:14.794002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1137/2275] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:14 2022] DELETE /identity/v3/projects/7d26eb79b9a442aaabe6d8c79d4ae12a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:14.797845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506e7d8-4361-4ecf-b153-c1b5c0c7ae0f service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:14.814791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506e7d8-4361-4ecf-b153-c1b5c0c7ae0f service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:14.923107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:14.924549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:14.925179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:14.925526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] PATH_INFO: `/v3/users/7e1f53e9965a43a5aaf9c39b94918d6c` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:14.927187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1f53e9965a43a5aaf9c39b94918d6c)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:14.930851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:15.011404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1f53e9965a43a5aaf9c39b94918d6c'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.026716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1f53e9965a43a5aaf9c39b94918d6c'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.036915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1f53e9965a43a5aaf9c39b94918d6c'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.038186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1f53e9965a43a5aaf9c39b94918d6c'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.054834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ba1623ad-e923-4b14-920b-433eb562ab73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1f53e9965a43a5aaf9c39b94918d6c'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.062938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1139/2276] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:14 2022] DELETE /identity/v3/users/7e1f53e9965a43a5aaf9c39b94918d6c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:15.492564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:15.494080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:15.518973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368632c-e573-4178-ac75-1d470a7db47c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:15.561546 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:15.607225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:15.607974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.608265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.608543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] PATH_INFO: `/v3/projects/be000bc98ff048b19892c5561c38d3ca` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.609883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be000bc98ff048b19892c5561c38d3ca)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:15.611646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:15.664940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be000bc98ff048b19892c5561c38d3ca', 'request_id': 'req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.674688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be000bc98ff048b19892c5561c38d3ca', 'request_id': 'req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.684882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be000bc98ff048b19892c5561c38d3ca', 'request_id': 'req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.697095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] The token cache is being invalidate because project be000bc98ff048b19892c5561c38d3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:15.697409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.698079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4d40c341-5a3c-4c57-8795-e8c76d5d9f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:15.699822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1138/2277] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:15 2022] DELETE /identity/v3/projects/be000bc98ff048b19892c5561c38d3ca => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:15.704498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8dbf0-0f3f-4388-a294-f32ad8db45a9 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.705051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8dbf0-0f3f-4388-a294-f32ad8db45a9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.705353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8dbf0-0f3f-4388-a294-f32ad8db45a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.726213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-bfd8dbf0-0f3f-4388-a294-f32ad8db45a9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:15.727424 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bfd8dbf0-0f3f-4388-a294-f32ad8db45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:15.762332 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:15.801895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1140/2278] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:15.810964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c87f0-3636-4ea3-a54b-724357c2199a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.811243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c87f0-3636-4ea3-a54b-724357c2199a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.811518 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c87f0-3636-4ea3-a54b-724357c2199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.842591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d99c87f0-3636-4ea3-a54b-724357c2199a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:15.843748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d99c87f0-3636-4ea3-a54b-724357c2199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:15.851866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1139/2279] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:15.856091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8dbf0-0f3f-4388-a294-f32ad8db45a9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:15.866128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8dbf0-0f3f-4388-a294-f32ad8db45a9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:15.871732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30812abb-a2ca-4c05-bfdc-cf2e2064e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:15.872406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30812abb-a2ca-4c05-bfdc-cf2e2064e536 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.872688 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30812abb-a2ca-4c05-bfdc-cf2e2064e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.872964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30812abb-a2ca-4c05-bfdc-cf2e2064e536 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.873822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30812abb-a2ca-4c05-bfdc-cf2e2064e536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:15.874167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30812abb-a2ca-4c05-bfdc-cf2e2064e536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:15.875805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30812abb-a2ca-4c05-bfdc-cf2e2064e536 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:15.891567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1141/2280] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:15.895952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c87f0-3636-4ea3-a54b-724357c2199a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:15.908144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c87f0-3636-4ea3-a54b-724357c2199a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:15.913062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a321f-109f-498f-94aa-70579a4a593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:15.913770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a321f-109f-498f-94aa-70579a4a593b admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:15.914050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a321f-109f-498f-94aa-70579a4a593b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:15.914321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a321f-109f-498f-94aa-70579a4a593b admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:15.914994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a321f-109f-498f-94aa-70579a4a593b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:15.917703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a321f-109f-498f-94aa-70579a4a593b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:15.952412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1140/2281] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:15 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:15.954311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30812abb-a2ca-4c05-bfdc-cf2e2064e536 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:15.971376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30812abb-a2ca-4c05-bfdc-cf2e2064e536 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.065710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf58f5d-6d10-4eca-82f0-df6bcb310b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.066296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf58f5d-6d10-4eca-82f0-df6bcb310b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.067191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf58f5d-6d10-4eca-82f0-df6bcb310b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.067191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf58f5d-6d10-4eca-82f0-df6bcb310b78 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.067589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf58f5d-6d10-4eca-82f0-df6bcb310b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.069785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf58f5d-6d10-4eca-82f0-df6bcb310b78 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.092948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1142/2282] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:15 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:16.097027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a321f-109f-498f-94aa-70579a4a593b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.107911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a321f-109f-498f-94aa-70579a4a593b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.112900 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8dc70-5eab-4a8a-9881-916ea1b635a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.113583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8dc70-5eab-4a8a-9881-916ea1b635a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.113860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8dc70-5eab-4a8a-9881-916ea1b635a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.114130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8dc70-5eab-4a8a-9881-916ea1b635a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.114814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8dc70-5eab-4a8a-9881-916ea1b635a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.116394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8dc70-5eab-4a8a-9881-916ea1b635a3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.127309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1141/2283] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:16.132403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf58f5d-6d10-4eca-82f0-df6bcb310b78 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.142473 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf58f5d-6d10-4eca-82f0-df6bcb310b78 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.147467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefb8ef-74ad-49fe-bfe2-8f7a090a1de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.148137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefb8ef-74ad-49fe-bfe2-8f7a090a1de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.148475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefb8ef-74ad-49fe-bfe2-8f7a090a1de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.148797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefb8ef-74ad-49fe-bfe2-8f7a090a1de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.149532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefb8ef-74ad-49fe-bfe2-8f7a090a1de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.156273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefb8ef-74ad-49fe-bfe2-8f7a090a1de5 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.167614 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1143/2284] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:16.172118 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8dc70-5eab-4a8a-9881-916ea1b635a3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.183561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8dc70-5eab-4a8a-9881-916ea1b635a3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.188177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726eaed-7bea-4e32-9fc7-03e0e4f93bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.188890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726eaed-7bea-4e32-9fc7-03e0e4f93bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.189223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726eaed-7bea-4e32-9fc7-03e0e4f93bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.189569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726eaed-7bea-4e32-9fc7-03e0e4f93bb7 admin admin] PATH_INFO: `/v3/projects/95264d3c739c457fb841bc48e6bf236f/users/c08ea0dcf3324e9fa3ef724ba4b2cf12/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.204431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726eaed-7bea-4e32-9fc7-03e0e4f93bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95264d3c739c457fb841bc48e6bf236f, user_id=c08ea0dcf3324e9fa3ef724ba4b2cf12, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.207206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726eaed-7bea-4e32-9fc7-03e0e4f93bb7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.221715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1142/2285] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:16 2022] PUT /identity/v3/projects/95264d3c739c457fb841bc48e6bf236f/users/c08ea0dcf3324e9fa3ef724ba4b2cf12/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:16.232209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2294b-dec3-48ce-9c5c-4641ab60488b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.232501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2294b-dec3-48ce-9c5c-4641ab60488b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.232778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2294b-dec3-48ce-9c5c-4641ab60488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.260608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-7ca2294b-dec3-48ce-9c5c-4641ab60488b None None] MFA Rules not processed for user `c08ea0dcf3324e9fa3ef724ba4b2cf12`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:16.261855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7ca2294b-dec3-48ce-9c5c-4641ab60488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:16.330123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1144/2286] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:16.334589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726eaed-7bea-4e32-9fc7-03e0e4f93bb7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.388843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:16.401349 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726eaed-7bea-4e32-9fc7-03e0e4f93bb7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.406049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715a716-7fd5-467f-b9b3-7e8b3dd882db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.406651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715a716-7fd5-467f-b9b3-7e8b3dd882db admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.406928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715a716-7fd5-467f-b9b3-7e8b3dd882db admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.407199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715a716-7fd5-467f-b9b3-7e8b3dd882db admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.407851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715a716-7fd5-467f-b9b3-7e8b3dd882db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.409777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715a716-7fd5-467f-b9b3-7e8b3dd882db admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.437166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1143/2287] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:16 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:16.441386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2294b-dec3-48ce-9c5c-4641ab60488b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.451985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2294b-dec3-48ce-9c5c-4641ab60488b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.478829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:16.512605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4921d7-7cb6-4f8b-93bb-7ba411ba000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.513557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4921d7-7cb6-4f8b-93bb-7ba411ba000b admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.513837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4921d7-7cb6-4f8b-93bb-7ba411ba000b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.514112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4921d7-7cb6-4f8b-93bb-7ba411ba000b admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.514792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4921d7-7cb6-4f8b-93bb-7ba411ba000b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.516703 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4921d7-7cb6-4f8b-93bb-7ba411ba000b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.540110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1145/2288] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:16 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:16.544168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715a716-7fd5-467f-b9b3-7e8b3dd882db admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.556343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715a716-7fd5-467f-b9b3-7e8b3dd882db admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.561928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860ebe-35b7-4cf8-9634-46ae48729ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.562635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860ebe-35b7-4cf8-9634-46ae48729ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.562920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860ebe-35b7-4cf8-9634-46ae48729ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.564487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860ebe-35b7-4cf8-9634-46ae48729ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.565575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860ebe-35b7-4cf8-9634-46ae48729ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.573823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860ebe-35b7-4cf8-9634-46ae48729ed8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.591855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1144/2289] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:16.596857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4921d7-7cb6-4f8b-93bb-7ba411ba000b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.615431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4921d7-7cb6-4f8b-93bb-7ba411ba000b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.620316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b94c-1e14-411a-8841-89e8a709f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.621431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b94c-1e14-411a-8841-89e8a709f8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.621779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b94c-1e14-411a-8841-89e8a709f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.622150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3b94c-1e14-411a-8841-89e8a709f8a6 admin admin] PATH_INFO: `/v3/projects/97a020301272428191bfc0e25bad85b0/users/e7592bdfa04b43a19379ab748e50c603/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.642123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b94c-1e14-411a-8841-89e8a709f8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a020301272428191bfc0e25bad85b0, user_id=e7592bdfa04b43a19379ab748e50c603, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.645516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3b94c-1e14-411a-8841-89e8a709f8a6 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.662012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1146/2290] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:16 2022] PUT /identity/v3/projects/97a020301272428191bfc0e25bad85b0/users/e7592bdfa04b43a19379ab748e50c603/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:16.666581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860ebe-35b7-4cf8-9634-46ae48729ed8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.677312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860ebe-35b7-4cf8-9634-46ae48729ed8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.764579 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa888c8-8a38-4f00-be7c-f7c7ad2c3f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.765270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa888c8-8a38-4f00-be7c-f7c7ad2c3f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.765523 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa888c8-8a38-4f00-be7c-f7c7ad2c3f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.765794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa888c8-8a38-4f00-be7c-f7c7ad2c3f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.766496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa888c8-8a38-4f00-be7c-f7c7ad2c3f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.768197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa888c8-8a38-4f00-be7c-f7c7ad2c3f22 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.781367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1145/2291] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:16.784156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b94c-1e14-411a-8841-89e8a709f8a6 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.794721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3b94c-1e14-411a-8841-89e8a709f8a6 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:16.800780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7f87c-498a-4173-83c9-2d0ffe970cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:16.801482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7f87c-498a-4173-83c9-2d0ffe970cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.801765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7f87c-498a-4173-83c9-2d0ffe970cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.802054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7f87c-498a-4173-83c9-2d0ffe970cc4 admin admin] PATH_INFO: `/v3/projects/97a020301272428191bfc0e25bad85b0/users/e7592bdfa04b43a19379ab748e50c603/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.804010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7f87c-498a-4173-83c9-2d0ffe970cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a020301272428191bfc0e25bad85b0, user_id=e7592bdfa04b43a19379ab748e50c603, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:16.806813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7f87c-498a-4173-83c9-2d0ffe970cc4 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:16.817174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1147/2292] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:16 2022] PUT /identity/v3/projects/97a020301272428191bfc0e25bad85b0/users/e7592bdfa04b43a19379ab748e50c603/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:16.827748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b975c-48b7-4235-9d27-82a8fa191395 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:16.828032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b975c-48b7-4235-9d27-82a8fa191395 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:16.828304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b975c-48b7-4235-9d27-82a8fa191395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:16.855428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-953b975c-48b7-4235-9d27-82a8fa191395 None None] MFA Rules not processed for user `e7592bdfa04b43a19379ab748e50c603`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:16.856612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-953b975c-48b7-4235-9d27-82a8fa191395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:16.930374 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1146/2293] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:16.941380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7f87c-498a-4173-83c9-2d0ffe970cc4 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:16.943504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-75f7f87c-498a-4173-83c9-2d0ffe970cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:17.011190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7f87c-498a-4173-83c9-2d0ffe970cc4 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:17.014865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ad141-0b3b-4866-9f12-7ce9df77b575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:17.015479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ad141-0b3b-4866-9f12-7ce9df77b575 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:17.015786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ad141-0b3b-4866-9f12-7ce9df77b575 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:17.016068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ad141-0b3b-4866-9f12-7ce9df77b575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:17.025838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ad141-0b3b-4866-9f12-7ce9df77b575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:17.027253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ad141-0b3b-4866-9f12-7ce9df77b575 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:17.037309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1148/2294] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:17.164196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b975c-48b7-4235-9d27-82a8fa191395 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:17.165713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-953b975c-48b7-4235-9d27-82a8fa191395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:17.182554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b975c-48b7-4235-9d27-82a8fa191395 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:17.191776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ad141-0b3b-4866-9f12-7ce9df77b575 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:17.197953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc8af7-f879-4669-8399-0ff5d80bf4d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:17.198973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc8af7-f879-4669-8399-0ff5d80bf4d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:17.199442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc8af7-f879-4669-8399-0ff5d80bf4d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:17.199910 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc8af7-f879-4669-8399-0ff5d80bf4d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:17.202160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-efdc8af7-f879-4669-8399-0ff5d80bf4d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:17.286004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:17.324798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ad141-0b3b-4866-9f12-7ce9df77b575 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:17.326651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc8af7-f879-4669-8399-0ff5d80bf4d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:17.328247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc8af7-f879-4669-8399-0ff5d80bf4d1 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:17.330051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:17.330883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:17.331307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:17.331813 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] PATH_INFO: `/v3/users/c08ea0dcf3324e9fa3ef724ba4b2cf12` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:17.333464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08ea0dcf3324e9fa3ef724ba4b2cf12)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:17.335758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:17.349611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1147/2295] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:17.369517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:17.398387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08ea0dcf3324e9fa3ef724ba4b2cf12'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.408879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08ea0dcf3324e9fa3ef724ba4b2cf12'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.419493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08ea0dcf3324e9fa3ef724ba4b2cf12'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.420672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08ea0dcf3324e9fa3ef724ba4b2cf12'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.437222 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08ea0dcf3324e9fa3ef724ba4b2cf12'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:17.447434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1149/2296] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:17 2022] DELETE /identity/v3/users/c08ea0dcf3324e9fa3ef724ba4b2cf12 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:17.449311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433300-9174-48dc-a6b7-30c834ff071d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:17.449628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433300-9174-48dc-a6b7-30c834ff071d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:17.450024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433300-9174-48dc-a6b7-30c834ff071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:17.469151 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-13433300-9174-48dc-a6b7-30c834ff071d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:17.470420 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-13433300-9174-48dc-a6b7-30c834ff071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:17.540333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1148/2297] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:17.550741 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:17.552417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:17.616123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8159-0a0c-47d0-b638-40a97417d93d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:17.620709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30f2ff-e515-4193-b78f-3dcf6319b11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:17.621371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30f2ff-e515-4193-b78f-3dcf6319b11d service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:17.621773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30f2ff-e515-4193-b78f-3dcf6319b11d service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:17.622115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30f2ff-e515-4193-b78f-3dcf6319b11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:17.644097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30f2ff-e515-4193-b78f-3dcf6319b11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:17.645841 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30f2ff-e515-4193-b78f-3dcf6319b11d service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:17.679020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1150/2298] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:18.235023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433300-9174-48dc-a6b7-30c834ff071d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:18.242956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-13433300-9174-48dc-a6b7-30c834ff071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:18.256345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433300-9174-48dc-a6b7-30c834ff071d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:18.262150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:18.262902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.263186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.263504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] PATH_INFO: `/v3/projects/95264d3c739c457fb841bc48e6bf236f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.264970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95264d3c739c457fb841bc48e6bf236f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:18.267365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.371267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95264d3c739c457fb841bc48e6bf236f', 'request_id': 'req-6b617c77-9e2d-4886-be47-2f9015634e13'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.387457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95264d3c739c457fb841bc48e6bf236f', 'request_id': 'req-6b617c77-9e2d-4886-be47-2f9015634e13'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.393715 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95264d3c739c457fb841bc48e6bf236f', 'request_id': 'req-6b617c77-9e2d-4886-be47-2f9015634e13'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.406938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] The token cache is being invalidate because project 95264d3c739c457fb841bc48e6bf236f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:18.407358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.408079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.409670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1149/2299] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:18 2022] DELETE /identity/v3/projects/95264d3c739c457fb841bc48e6bf236f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:18.413626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30f2ff-e515-4193-b78f-3dcf6319b11d service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:18.424135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30f2ff-e515-4193-b78f-3dcf6319b11d service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:18.489800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:18.490747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.491114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.491487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] PATH_INFO: `/v3/users/e7592bdfa04b43a19379ab748e50c603` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.492805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7592bdfa04b43a19379ab748e50c603)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:18.494830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.542101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7592bdfa04b43a19379ab748e50c603'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.543787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:18.556176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7592bdfa04b43a19379ab748e50c603'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.569364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7592bdfa04b43a19379ab748e50c603'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.571060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7592bdfa04b43a19379ab748e50c603'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.587034 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5db7e5b5-3083-413c-a771-1b6c771852bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7592bdfa04b43a19379ab748e50c603'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:18.593845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1151/2300] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:18 2022] DELETE /identity/v3/users/e7592bdfa04b43a19379ab748e50c603 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:18.878968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:18.881602 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:18.901545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b617c77-9e2d-4886-be47-2f9015634e13 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:18.969255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:18.969930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:18.970210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:18.970480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] PATH_INFO: `/v3/projects/97a020301272428191bfc0e25bad85b0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:18.971628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a020301272428191bfc0e25bad85b0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:18.973558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:18.984292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:19.034233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a020301272428191bfc0e25bad85b0', 'request_id': 'req-bbcb4a96-5b26-4223-ba69-c20a25fdac98'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:19.046094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a020301272428191bfc0e25bad85b0', 'request_id': 'req-bbcb4a96-5b26-4223-ba69-c20a25fdac98'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:19.053131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a020301272428191bfc0e25bad85b0', 'request_id': 'req-bbcb4a96-5b26-4223-ba69-c20a25fdac98'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:19.065723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] The token cache is being invalidate because project 97a020301272428191bfc0e25bad85b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:19.066012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:19.066783 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbcb4a96-5b26-4223-ba69-c20a25fdac98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:19.068446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1150/2301] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:18 2022] DELETE /identity/v3/projects/97a020301272428191bfc0e25bad85b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:19.074794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68513cd3-ff6b-4676-81f9-9897603e6027 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.075163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68513cd3-ff6b-4676-81f9-9897603e6027 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.075579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68513cd3-ff6b-4676-81f9-9897603e6027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.095940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-68513cd3-ff6b-4676-81f9-9897603e6027 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:19.097170 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-68513cd3-ff6b-4676-81f9-9897603e6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:19.158111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1152/2302] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:19.167347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd6816-d4a4-4694-834a-3ac03050316e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.167649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd6816-d4a4-4694-834a-3ac03050316e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.167931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd6816-d4a4-4694-834a-3ac03050316e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.188837 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ddbd6816-d4a4-4694-834a-3ac03050316e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:19.189485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ddbd6816-d4a4-4694-834a-3ac03050316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:19.197957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1151/2303] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:19.202416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68513cd3-ff6b-4676-81f9-9897603e6027 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.212310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68513cd3-ff6b-4676-81f9-9897603e6027 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.216923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83082b-0aee-494f-949f-b064fa1e7f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.217571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83082b-0aee-494f-949f-b064fa1e7f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.217856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83082b-0aee-494f-949f-b064fa1e7f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.218130 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83082b-0aee-494f-949f-b064fa1e7f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.218825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83082b-0aee-494f-949f-b064fa1e7f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:19.219128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83082b-0aee-494f-949f-b064fa1e7f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.220723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83082b-0aee-494f-949f-b064fa1e7f1e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.233622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1153/2304] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:19.237977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd6816-d4a4-4694-834a-3ac03050316e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.248461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd6816-d4a4-4694-834a-3ac03050316e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.253145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b06a2c-88b7-45ee-96f4-9d71df5eeb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.253801 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b06a2c-88b7-45ee-96f4-9d71df5eeb22 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.254051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b06a2c-88b7-45ee-96f4-9d71df5eeb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.254493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b06a2c-88b7-45ee-96f4-9d71df5eeb22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.255525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b06a2c-88b7-45ee-96f4-9d71df5eeb22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.257470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b06a2c-88b7-45ee-96f4-9d71df5eeb22 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.283964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1152/2305] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:19.288875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83082b-0aee-494f-949f-b064fa1e7f1e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.300381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83082b-0aee-494f-949f-b064fa1e7f1e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.368561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc1e51-ef5d-4fbe-b7fe-2f2ba031f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.369369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc1e51-ef5d-4fbe-b7fe-2f2ba031f176 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.369756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc1e51-ef5d-4fbe-b7fe-2f2ba031f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.370133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc1e51-ef5d-4fbe-b7fe-2f2ba031f176 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.370897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc1e51-ef5d-4fbe-b7fe-2f2ba031f176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.373108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc1e51-ef5d-4fbe-b7fe-2f2ba031f176 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.400180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1154/2306] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:19.404432 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b06a2c-88b7-45ee-96f4-9d71df5eeb22 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.419046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b06a2c-88b7-45ee-96f4-9d71df5eeb22 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.424094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26ac11-c414-43e8-9e72-abb5bda626c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.425060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26ac11-c414-43e8-9e72-abb5bda626c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.425371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26ac11-c414-43e8-9e72-abb5bda626c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.425653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26ac11-c414-43e8-9e72-abb5bda626c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.426405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26ac11-c414-43e8-9e72-abb5bda626c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.428032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26ac11-c414-43e8-9e72-abb5bda626c8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.441364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1153/2307] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:19.443174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc1e51-ef5d-4fbe-b7fe-2f2ba031f176 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.453523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc1e51-ef5d-4fbe-b7fe-2f2ba031f176 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.458330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eec47-883f-4a3e-a528-3a405c178a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.459016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eec47-883f-4a3e-a528-3a405c178a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.459497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eec47-883f-4a3e-a528-3a405c178a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.459835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eec47-883f-4a3e-a528-3a405c178a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.461123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eec47-883f-4a3e-a528-3a405c178a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.462753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eec47-883f-4a3e-a528-3a405c178a31 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.477383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1155/2308] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:19.481092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26ac11-c414-43e8-9e72-abb5bda626c8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.493091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26ac11-c414-43e8-9e72-abb5bda626c8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.500618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502988d-4812-4fd7-9d7c-a2f6cb61e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.501291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502988d-4812-4fd7-9d7c-a2f6cb61e4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.501636 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502988d-4812-4fd7-9d7c-a2f6cb61e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.501912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502988d-4812-4fd7-9d7c-a2f6cb61e4e8 admin admin] PATH_INFO: `/v3/projects/17816751c4694000a4de0f122b8e9392/users/d0eec991350747ec907240d9b487a87d/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.518813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502988d-4812-4fd7-9d7c-a2f6cb61e4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17816751c4694000a4de0f122b8e9392, user_id=d0eec991350747ec907240d9b487a87d, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.521869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502988d-4812-4fd7-9d7c-a2f6cb61e4e8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.537361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1154/2309] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:19 2022] PUT /identity/v3/projects/17816751c4694000a4de0f122b8e9392/users/d0eec991350747ec907240d9b487a87d/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:19.547969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d408e-dac2-4839-8ff2-343793d9998b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.548935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d408e-dac2-4839-8ff2-343793d9998b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.549562 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d408e-dac2-4839-8ff2-343793d9998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.590492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2e1d408e-dac2-4839-8ff2-343793d9998b None None] MFA Rules not processed for user `d0eec991350747ec907240d9b487a87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:19.591749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2e1d408e-dac2-4839-8ff2-343793d9998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:19.612349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:19.662387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1156/2310] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:19.667084 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502988d-4812-4fd7-9d7c-a2f6cb61e4e8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.749455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502988d-4812-4fd7-9d7c-a2f6cb61e4e8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.756478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26bc47-bd80-46f3-aa14-9b2bf34d5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.758495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26bc47-bd80-46f3-aa14-9b2bf34d5f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.758998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26bc47-bd80-46f3-aa14-9b2bf34d5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.759422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26bc47-bd80-46f3-aa14-9b2bf34d5f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.760429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26bc47-bd80-46f3-aa14-9b2bf34d5f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.763929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26bc47-bd80-46f3-aa14-9b2bf34d5f86 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.814060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1155/2311] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:19.823948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d408e-dac2-4839-8ff2-343793d9998b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.839678 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d408e-dac2-4839-8ff2-343793d9998b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.902040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a3838-457b-4acc-a1f0-0740e0509e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.902658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a3838-457b-4acc-a1f0-0740e0509e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.903444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a3838-457b-4acc-a1f0-0740e0509e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.903444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a3838-457b-4acc-a1f0-0740e0509e55 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.903894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a3838-457b-4acc-a1f0-0740e0509e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.905838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a3838-457b-4acc-a1f0-0740e0509e55 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.944123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1157/2312] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:19 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:19.949127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26bc47-bd80-46f3-aa14-9b2bf34d5f86 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:19.966085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26bc47-bd80-46f3-aa14-9b2bf34d5f86 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:19.971795 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb22b59-c6d5-4d54-aa34-ff21678ff0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:19.972773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb22b59-c6d5-4d54-aa34-ff21678ff0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:19.973144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb22b59-c6d5-4d54-aa34-ff21678ff0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:19.973576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb22b59-c6d5-4d54-aa34-ff21678ff0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:19.974940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb22b59-c6d5-4d54-aa34-ff21678ff0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:19.976866 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb22b59-c6d5-4d54-aa34-ff21678ff0a2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:19.991935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1156/2313] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:19.993145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a3838-457b-4acc-a1f0-0740e0509e55 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:20.003735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a3838-457b-4acc-a1f0-0740e0509e55 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:20.010195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092edd2-064b-41ad-9072-99f4bdfd5075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:20.010940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092edd2-064b-41ad-9072-99f4bdfd5075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:20.011315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092edd2-064b-41ad-9072-99f4bdfd5075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:20.011662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092edd2-064b-41ad-9072-99f4bdfd5075 admin admin] PATH_INFO: `/v3/projects/0ce4881749dc42bca0539b0d747571e1/users/3893457b5f154078ab2f21b8f3d65ece/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:20.035740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092edd2-064b-41ad-9072-99f4bdfd5075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce4881749dc42bca0539b0d747571e1, user_id=3893457b5f154078ab2f21b8f3d65ece, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:20.038557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092edd2-064b-41ad-9072-99f4bdfd5075 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:20.066246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1158/2314] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:19 2022] PUT /identity/v3/projects/0ce4881749dc42bca0539b0d747571e1/users/3893457b5f154078ab2f21b8f3d65ece/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:20.068131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb22b59-c6d5-4d54-aa34-ff21678ff0a2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:20.075910 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:20.084330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb22b59-c6d5-4d54-aa34-ff21678ff0a2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:20.180026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57859376-e2be-4ce7-89a7-ae9eef5e52f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:20.180644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57859376-e2be-4ce7-89a7-ae9eef5e52f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:20.180962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57859376-e2be-4ce7-89a7-ae9eef5e52f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:20.181236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57859376-e2be-4ce7-89a7-ae9eef5e52f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:20.181991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57859376-e2be-4ce7-89a7-ae9eef5e52f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:20.183640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57859376-e2be-4ce7-89a7-ae9eef5e52f6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:20.195407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1157/2315] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:20.199437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092edd2-064b-41ad-9072-99f4bdfd5075 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:20.210006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092edd2-064b-41ad-9072-99f4bdfd5075 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:20.217306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36949a65-21ae-4b37-829b-5b2bcac9c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:20.218017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36949a65-21ae-4b37-829b-5b2bcac9c55e admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:20.218296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36949a65-21ae-4b37-829b-5b2bcac9c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:20.218568 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36949a65-21ae-4b37-829b-5b2bcac9c55e admin admin] PATH_INFO: `/v3/projects/0ce4881749dc42bca0539b0d747571e1/users/3893457b5f154078ab2f21b8f3d65ece/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:20.220496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36949a65-21ae-4b37-829b-5b2bcac9c55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce4881749dc42bca0539b0d747571e1, user_id=3893457b5f154078ab2f21b8f3d65ece, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:20.223319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36949a65-21ae-4b37-829b-5b2bcac9c55e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:20.234844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1159/2316] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:20 2022] PUT /identity/v3/projects/0ce4881749dc42bca0539b0d747571e1/users/3893457b5f154078ab2f21b8f3d65ece/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:20.246704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5fd0-3908-4f3b-a81b-3e471a85683f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:20.247113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5fd0-3908-4f3b-a81b-3e471a85683f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:20.247426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5fd0-3908-4f3b-a81b-3e471a85683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:20.278788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f6bb5fd0-3908-4f3b-a81b-3e471a85683f None None] MFA Rules not processed for user `3893457b5f154078ab2f21b8f3d65ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:20.280000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f6bb5fd0-3908-4f3b-a81b-3e471a85683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:20.348295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1158/2317] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:20.359242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36949a65-21ae-4b37-829b-5b2bcac9c55e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:20.360960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-36949a65-21ae-4b37-829b-5b2bcac9c55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:20.423868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36949a65-21ae-4b37-829b-5b2bcac9c55e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:20.427520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ad5d1-9bcd-4355-90fa-684232f58f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:20.428127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ad5d1-9bcd-4355-90fa-684232f58f23 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:20.428404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ad5d1-9bcd-4355-90fa-684232f58f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:20.428685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ad5d1-9bcd-4355-90fa-684232f58f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:20.439739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ad5d1-9bcd-4355-90fa-684232f58f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:20.440952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ad5d1-9bcd-4355-90fa-684232f58f23 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:20.451190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1160/2318] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:21.168930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb5fd0-3908-4f3b-a81b-3e471a85683f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:21.238491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb5fd0-3908-4f3b-a81b-3e471a85683f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:21.243258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:21.244105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:21.244383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:21.244729 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] PATH_INFO: `/v3/users/d0eec991350747ec907240d9b487a87d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:21.245916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0eec991350747ec907240d9b487a87d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:21.247946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:21.284221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:21.307306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0eec991350747ec907240d9b487a87d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.320259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0eec991350747ec907240d9b487a87d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.334889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0eec991350747ec907240d9b487a87d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.342667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0eec991350747ec907240d9b487a87d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.345144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ee8b449c-8d64-4eaf-99dc-cdf05e420cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0eec991350747ec907240d9b487a87d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:21.350211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01028f61-c3fa-4ebe-a548-0127da9c907a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:21.350525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01028f61-c3fa-4ebe-a548-0127da9c907a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:21.351063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01028f61-c3fa-4ebe-a548-0127da9c907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:21.373440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1159/2319] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:21 2022] DELETE /identity/v3/users/d0eec991350747ec907240d9b487a87d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:21.377880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1e22-f627-439b-8946-3e0f2700e224 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:21.378552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1e22-f627-439b-8946-3e0f2700e224 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:21.379067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1e22-f627-439b-8946-3e0f2700e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:21.379504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-01028f61-c3fa-4ebe-a548-0127da9c907a None None] MFA Rules not processed for user `1553810df7084cfa9451f2582043a423`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:21.381493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-01028f61-c3fa-4ebe-a548-0127da9c907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:21.393748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:21.414880 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bf6f1e22-f627-439b-8946-3e0f2700e224 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:21.416212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bf6f1e22-f627-439b-8946-3e0f2700e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:21.451019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1161/2320] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:21.492545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1160/2321] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:21.503443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01028f61-c3fa-4ebe-a548-0127da9c907a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:21.505310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-01028f61-c3fa-4ebe-a548-0127da9c907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:21.571168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01028f61-c3fa-4ebe-a548-0127da9c907a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:21.575184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdf43f-488e-4489-a415-ee59060d4c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:21.575880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf43f-488e-4489-a415-ee59060d4c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:21.576372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf43f-488e-4489-a415-ee59060d4c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:21.577133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf43f-488e-4489-a415-ee59060d4c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:21.589855 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdf43f-488e-4489-a415-ee59060d4c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:21.591593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdf43f-488e-4489-a415-ee59060d4c29 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:21.605036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1162/2322] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:22.064321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f1e22-f627-439b-8946-3e0f2700e224 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:22.065871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bf6f1e22-f627-439b-8946-3e0f2700e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:22.078712 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f1e22-f627-439b-8946-3e0f2700e224 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:22.084348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:22.085082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.085533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.086050 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] PATH_INFO: `/v3/projects/17816751c4694000a4de0f122b8e9392` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.088146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=17816751c4694000a4de0f122b8e9392)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:22.090219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:22.166619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17816751c4694000a4de0f122b8e9392', 'request_id': 'req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.177577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17816751c4694000a4de0f122b8e9392', 'request_id': 'req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.186673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17816751c4694000a4de0f122b8e9392', 'request_id': 'req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.207336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] The token cache is being invalidate because project 17816751c4694000a4de0f122b8e9392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:22.207633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.208375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.211626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1161/2323] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:22 2022] DELETE /identity/v3/projects/17816751c4694000a4de0f122b8e9392 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:22.216068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdf43f-488e-4489-a415-ee59060d4c29 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:22.242608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdf43f-488e-4489-a415-ee59060d4c29 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:22.436542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:22.437234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.437552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.437829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] PATH_INFO: `/v3/users/3893457b5f154078ab2f21b8f3d65ece` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.441076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3893457b5f154078ab2f21b8f3d65ece)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:22.443244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:22.458594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:22.462664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:22.489888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a4df1-d1de-4c4d-9404-7bf7e91dc89f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:22.508922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:22.509609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.510055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.510510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] PATH_INFO: `/v3/users/4aa6b823e24945f2af87059b1b203641` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.512167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa6b823e24945f2af87059b1b203641)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:22.514126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:22.551568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:22.586725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3893457b5f154078ab2f21b8f3d65ece'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.602324 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3893457b5f154078ab2f21b8f3d65ece'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.606550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa6b823e24945f2af87059b1b203641'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.618424 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa6b823e24945f2af87059b1b203641'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.623520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3893457b5f154078ab2f21b8f3d65ece'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.625213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3893457b5f154078ab2f21b8f3d65ece'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.631148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:22.640773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa6b823e24945f2af87059b1b203641'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.643292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa6b823e24945f2af87059b1b203641'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.644787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa6b823e24945f2af87059b1b203641'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.664743 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-948eb762-e1c5-4960-90e1-8c7d32931e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3893457b5f154078ab2f21b8f3d65ece'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:22.675662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1163/2324] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:22 2022] DELETE /identity/v3/users/3893457b5f154078ab2f21b8f3d65ece => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:22.701640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1162/2325] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:22 2022] DELETE /identity/v3/users/4aa6b823e24945f2af87059b1b203641 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:22.707637 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091712d3-b69b-4066-96d5-eb319861fb15 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.707949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091712d3-b69b-4066-96d5-eb319861fb15 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.708575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091712d3-b69b-4066-96d5-eb319861fb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.736899 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-091712d3-b69b-4066-96d5-eb319861fb15 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:22.739153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-091712d3-b69b-4066-96d5-eb319861fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:22.823767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1164/2326] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:22.833375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:22.836665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:22.922803 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a15e6a-3446-49f6-900a-02d5c5f0f7b9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:22.927364 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dde789-ce22-4e49-92d4-328f8bbac0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:22.927990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dde789-ce22-4e49-92d4-328f8bbac0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:22.928270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dde789-ce22-4e49-92d4-328f8bbac0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:22.928547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dde789-ce22-4e49-92d4-328f8bbac0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:22.941746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dde789-ce22-4e49-92d4-328f8bbac0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:22.944328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dde789-ce22-4e49-92d4-328f8bbac0a2 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:22.957517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1163/2327] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:23.056436 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091712d3-b69b-4066-96d5-eb319861fb15 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.057757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-091712d3-b69b-4066-96d5-eb319861fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:23.078150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091712d3-b69b-4066-96d5-eb319861fb15 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.089715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.090272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.090911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.090911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] PATH_INFO: `/v3/projects/0ce4881749dc42bca0539b0d747571e1` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.092142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce4881749dc42bca0539b0d747571e1)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.094725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.186499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce4881749dc42bca0539b0d747571e1', 'request_id': 'req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.211321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce4881749dc42bca0539b0d747571e1', 'request_id': 'req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.220991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce4881749dc42bca0539b0d747571e1', 'request_id': 'req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.245387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] The token cache is being invalidate because project 0ce4881749dc42bca0539b0d747571e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:23.246018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.246558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d93caf6b-c08b-4ca7-a9a4-f3f661c7bd5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.248384 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1165/2328] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:23 2022] DELETE /identity/v3/projects/0ce4881749dc42bca0539b0d747571e1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:23.256672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d6b83-cc1d-4d0e-9c3c-74c72ca621f3 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.256993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d6b83-cc1d-4d0e-9c3c-74c72ca621f3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.257811 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d6b83-cc1d-4d0e-9c3c-74c72ca621f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.279447 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-424d6b83-cc1d-4d0e-9c3c-74c72ca621f3 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:23.280652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-424d6b83-cc1d-4d0e-9c3c-74c72ca621f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:23.345988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1164/2329] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:23.354974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4eaa-0d9e-4aa5-8b43-b42d3cee40de None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.355268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4eaa-0d9e-4aa5-8b43-b42d3cee40de None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.355549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4eaa-0d9e-4aa5-8b43-b42d3cee40de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.376639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-cc2b4eaa-0d9e-4aa5-8b43-b42d3cee40de None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:23.377894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-cc2b4eaa-0d9e-4aa5-8b43-b42d3cee40de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:23.386837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1166/2330] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:23.391190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d6b83-cc1d-4d0e-9c3c-74c72ca621f3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.401790 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d6b83-cc1d-4d0e-9c3c-74c72ca621f3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.406785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50bee0-6cf7-4e33-a374-451be45514fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.407388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50bee0-6cf7-4e33-a374-451be45514fe admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.407667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50bee0-6cf7-4e33-a374-451be45514fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.407937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50bee0-6cf7-4e33-a374-451be45514fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.408634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50bee0-6cf7-4e33-a374-451be45514fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:23.408934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50bee0-6cf7-4e33-a374-451be45514fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.410611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50bee0-6cf7-4e33-a374-451be45514fe admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.422460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1165/2331] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:23.426803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b4eaa-0d9e-4aa5-8b43-b42d3cee40de None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.436950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b4eaa-0d9e-4aa5-8b43-b42d3cee40de None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.442081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722cf3a-646d-4e4e-b5a4-11b660513985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.442697 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722cf3a-646d-4e4e-b5a4-11b660513985 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.442974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722cf3a-646d-4e4e-b5a4-11b660513985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.443246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722cf3a-646d-4e4e-b5a4-11b660513985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.443948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722cf3a-646d-4e4e-b5a4-11b660513985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.446521 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722cf3a-646d-4e4e-b5a4-11b660513985 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.493632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1167/2332] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:23 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:23.499325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50bee0-6cf7-4e33-a374-451be45514fe admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.518954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50bee0-6cf7-4e33-a374-451be45514fe admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.560587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:23.639986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e110-5f63-4df0-85b4-05a540d11885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.640737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e110-5f63-4df0-85b4-05a540d11885 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.641841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e110-5f63-4df0-85b4-05a540d11885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.642124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e110-5f63-4df0-85b4-05a540d11885 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.642902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918e110-5f63-4df0-85b4-05a540d11885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.645857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918e110-5f63-4df0-85b4-05a540d11885 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.709686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1166/2333] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:23 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:23.713802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722cf3a-646d-4e4e-b5a4-11b660513985 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.728518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722cf3a-646d-4e4e-b5a4-11b660513985 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.734860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16495c3-1353-4e17-a70f-5b9f61a9f82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.735494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16495c3-1353-4e17-a70f-5b9f61a9f82f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.735777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16495c3-1353-4e17-a70f-5b9f61a9f82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.736052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16495c3-1353-4e17-a70f-5b9f61a9f82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.751437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16495c3-1353-4e17-a70f-5b9f61a9f82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.755765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16495c3-1353-4e17-a70f-5b9f61a9f82f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.772098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1168/2334] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:23.776193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e110-5f63-4df0-85b4-05a540d11885 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.794862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16495c3-1353-4e17-a70f-5b9f61a9f82f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.799438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c16495c3-1353-4e17-a70f-5b9f61a9f82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:23.815200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16495c3-1353-4e17-a70f-5b9f61a9f82f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.820778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.821706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.822182 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.822608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] PATH_INFO: `/v3/projects/4e6e3bbe55a44f599b7cd3a29de99a5a` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.824566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6e3bbe55a44f599b7cd3a29de99a5a)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.826544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.834558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e110-5f63-4df0-85b4-05a540d11885 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.848422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab29319-ed1d-4f34-b869-13e8ad5c83a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.849119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab29319-ed1d-4f34-b869-13e8ad5c83a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.849453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab29319-ed1d-4f34-b869-13e8ad5c83a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.849736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab29319-ed1d-4f34-b869-13e8ad5c83a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.851502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab29319-ed1d-4f34-b869-13e8ad5c83a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.855965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab29319-ed1d-4f34-b869-13e8ad5c83a5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.877461 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:23.882793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1167/2335] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:23.888000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab29319-ed1d-4f34-b869-13e8ad5c83a5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:23.907867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab29319-ed1d-4f34-b869-13e8ad5c83a5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:23.913821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3faf7-b5d2-40b3-a500-746d6921423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:23.914806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3faf7-b5d2-40b3-a500-746d6921423b admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.915098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3faf7-b5d2-40b3-a500-746d6921423b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.915445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3faf7-b5d2-40b3-a500-746d6921423b admin admin] PATH_INFO: `/v3/projects/ffafedce6a1b4dadb001f936e53d5da6/users/363af2f369804f08b953917dac887674/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:23.933197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3faf7-b5d2-40b3-a500-746d6921423b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffafedce6a1b4dadb001f936e53d5da6, user_id=363af2f369804f08b953917dac887674, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:23.936638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3faf7-b5d2-40b3-a500-746d6921423b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:23.950457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6e3bbe55a44f599b7cd3a29de99a5a', 'request_id': 'req-b7d3fa5e-8189-4064-b137-8d8613b9b109'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.962983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6e3bbe55a44f599b7cd3a29de99a5a', 'request_id': 'req-b7d3fa5e-8189-4064-b137-8d8613b9b109'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.971641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1168/2336] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:23 2022] PUT /identity/v3/projects/ffafedce6a1b4dadb001f936e53d5da6/users/363af2f369804f08b953917dac887674/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:23.981002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6e3bbe55a44f599b7cd3a29de99a5a', 'request_id': 'req-b7d3fa5e-8189-4064-b137-8d8613b9b109'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:23.982573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474950f-74cd-4857-b8ca-819f854597b1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:23.982868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474950f-74cd-4857-b8ca-819f854597b1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:23.983179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474950f-74cd-4857-b8ca-819f854597b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.000227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] The token cache is being invalidate because project 4e6e3bbe55a44f599b7cd3a29de99a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:24.000519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.001188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.002934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1169/2337] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:23 2022] DELETE /identity/v3/projects/4e6e3bbe55a44f599b7cd3a29de99a5a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:24.007188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.008584 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.044750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a474950f-74cd-4857-b8ca-819f854597b1 None None] MFA Rules not processed for user `363af2f369804f08b953917dac887674`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:24.046732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a474950f-74cd-4857-b8ca-819f854597b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.086062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3fa5e-8189-4064-b137-8d8613b9b109 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.132185 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1169/2338] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:24.145948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474950f-74cd-4857-b8ca-819f854597b1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.147511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a474950f-74cd-4857-b8ca-819f854597b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.157129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.158079 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.159370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.159683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] PATH_INFO: `/v3/users/59fc790b99584741a5594e36e64c3058` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.161147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fc790b99584741a5594e36e64c3058)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.164054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.211345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474950f-74cd-4857-b8ca-819f854597b1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.215642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca66d4d-75f5-4058-87cb-11184fa6eeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.216200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca66d4d-75f5-4058-87cb-11184fa6eeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.216477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca66d4d-75f5-4058-87cb-11184fa6eeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.216802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca66d4d-75f5-4058-87cb-11184fa6eeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.221527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fc790b99584741a5594e36e64c3058'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.226489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca66d4d-75f5-4058-87cb-11184fa6eeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.228355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca66d4d-75f5-4058-87cb-11184fa6eeb5 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.231566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fc790b99584741a5594e36e64c3058'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.237978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:24.239115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1170/2339] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:24.241666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fc790b99584741a5594e36e64c3058'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.242655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fc790b99584741a5594e36e64c3058'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.260041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1a94fb51-4c5f-4245-bc14-1fc0eed5ae7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fc790b99584741a5594e36e64c3058'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.266693 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca66d4d-75f5-4058-87cb-11184fa6eeb5 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.269189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2ca66d4d-75f5-4058-87cb-11184fa6eeb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.284700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1170/2340] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:24 2022] DELETE /identity/v3/users/59fc790b99584741a5594e36e64c3058 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:24.290132 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca66d4d-75f5-4058-87cb-11184fa6eeb5 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.305304 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:24.370266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.370925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.371323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.371577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] PATH_INFO: `/v3/users/363af2f369804f08b953917dac887674` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.372876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] RBAC: Authorizing `identity:delete_user(user_id=363af2f369804f08b953917dac887674)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.375484 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.525289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363af2f369804f08b953917dac887674'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.537210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363af2f369804f08b953917dac887674'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.548565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363af2f369804f08b953917dac887674'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.550350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363af2f369804f08b953917dac887674'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.550621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363af2f369804f08b953917dac887674'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:24.581580 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1171/2341] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:24 2022] DELETE /identity/v3/users/363af2f369804f08b953917dac887674 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:24.582225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8cf52-b3ca-4534-b3f6-12089aa3c70c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.582491 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8cf52-b3ca-4534-b3f6-12089aa3c70c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.582834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8cf52-b3ca-4534-b3f6-12089aa3c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.610195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-d5c8cf52-b3ca-4534-b3f6-12089aa3c70c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:24.611440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d5c8cf52-b3ca-4534-b3f6-12089aa3c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.714248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1171/2342] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:24.729107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.731098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.799214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab25b41-d3fb-4e50-92e6-0cfff1af178d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.805675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a44978-de4c-4b25-9a2a-1524d58ec2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.806335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a44978-de4c-4b25-9a2a-1524d58ec2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.806673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a44978-de4c-4b25-9a2a-1524d58ec2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.807030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a44978-de4c-4b25-9a2a-1524d58ec2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.822346 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8cf52-b3ca-4534-b3f6-12089aa3c70c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:24.824654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d5c8cf52-b3ca-4534-b3f6-12089aa3c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:24.845609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a44978-de4c-4b25-9a2a-1524d58ec2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.845609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a44978-de4c-4b25-9a2a-1524d58ec2a1 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.856435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8cf52-b3ca-4534-b3f6-12089aa3c70c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:24.859447 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1172/2343] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:24.866790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:24.868154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:24.868856 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:24.869571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] PATH_INFO: `/v3/projects/22709e07de814fc786e28e98179eb944` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:24.872493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22709e07de814fc786e28e98179eb944)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:24.888895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:24.974020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22709e07de814fc786e28e98179eb944', 'request_id': 'req-fce6a72f-4454-45b3-861c-bf524de2c09b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.003552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22709e07de814fc786e28e98179eb944', 'request_id': 'req-fce6a72f-4454-45b3-861c-bf524de2c09b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.013620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22709e07de814fc786e28e98179eb944', 'request_id': 'req-fce6a72f-4454-45b3-861c-bf524de2c09b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.037313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] The token cache is being invalidate because project 22709e07de814fc786e28e98179eb944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:25.037661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.038986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-fce6a72f-4454-45b3-861c-bf524de2c09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.042801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1172/2344] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:24 2022] DELETE /identity/v3/projects/22709e07de814fc786e28e98179eb944 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:25.049405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109f716-60cb-445b-b9cc-313a9c943faf None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.049405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109f716-60cb-445b-b9cc-313a9c943faf None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.049405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109f716-60cb-445b-b9cc-313a9c943faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.097964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1109f716-60cb-445b-b9cc-313a9c943faf None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:25.100033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1109f716-60cb-445b-b9cc-313a9c943faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.158766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:25.213682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1173/2345] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:25.223540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eef24-d509-424d-b3f0-4c60fe83a49c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.223927 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eef24-d509-424d-b3f0-4c60fe83a49c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.224363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eef24-d509-424d-b3f0-4c60fe83a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.262049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4f4eef24-d509-424d-b3f0-4c60fe83a49c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:25.264499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4f4eef24-d509-424d-b3f0-4c60fe83a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.274853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1173/2346] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:25.279176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109f716-60cb-445b-b9cc-313a9c943faf None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.291869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109f716-60cb-445b-b9cc-313a9c943faf None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.298144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49489c3-7438-4f75-b997-daa0784949b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.298912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49489c3-7438-4f75-b997-daa0784949b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.299073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49489c3-7438-4f75-b997-daa0784949b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.299387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49489c3-7438-4f75-b997-daa0784949b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.300182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49489c3-7438-4f75-b997-daa0784949b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:25.300548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49489c3-7438-4f75-b997-daa0784949b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.302293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49489c3-7438-4f75-b997-daa0784949b5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.324479 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1174/2347] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:37:25.324721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4eef24-d509-424d-b3f0-4c60fe83a49c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.334705 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4eef24-d509-424d-b3f0-4c60fe83a49c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.339585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d0aba-b73c-4942-92d9-f10c2a85eeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.340217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d0aba-b73c-4942-92d9-f10c2a85eeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.340499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d0aba-b73c-4942-92d9-f10c2a85eeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.340774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d0aba-b73c-4942-92d9-f10c2a85eeb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.341496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d0aba-b73c-4942-92d9-f10c2a85eeb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.343453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d0aba-b73c-4942-92d9-f10c2a85eeb4 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.381140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1174/2348] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:25.385127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49489c3-7438-4f75-b997-daa0784949b5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.395588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49489c3-7438-4f75-b997-daa0784949b5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.459917 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22789f-31a6-4526-94e9-43a8435d62c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.461086 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22789f-31a6-4526-94e9-43a8435d62c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.461406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22789f-31a6-4526-94e9-43a8435d62c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.461695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22789f-31a6-4526-94e9-43a8435d62c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.462351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22789f-31a6-4526-94e9-43a8435d62c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.464280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22789f-31a6-4526-94e9-43a8435d62c4 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.487211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1175/2349] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:25.491091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d0aba-b73c-4942-92d9-f10c2a85eeb4 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.502098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d0aba-b73c-4942-92d9-f10c2a85eeb4 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.507472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09117bb1-ace2-4614-ab0d-15f158f70560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.508113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117bb1-ace2-4614-ab0d-15f158f70560 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.508398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117bb1-ace2-4614-ab0d-15f158f70560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.509217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117bb1-ace2-4614-ab0d-15f158f70560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.509537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09117bb1-ace2-4614-ab0d-15f158f70560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.511145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09117bb1-ace2-4614-ab0d-15f158f70560 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.528612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22789f-31a6-4526-94e9-43a8435d62c4 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.529294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1175/2350] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:25.540964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22789f-31a6-4526-94e9-43a8435d62c4 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.546918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead1b6d-74d1-4d2f-9eb8-afb76192e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.547673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead1b6d-74d1-4d2f-9eb8-afb76192e964 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.548119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead1b6d-74d1-4d2f-9eb8-afb76192e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.548388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead1b6d-74d1-4d2f-9eb8-afb76192e964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.549256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead1b6d-74d1-4d2f-9eb8-afb76192e964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.551019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead1b6d-74d1-4d2f-9eb8-afb76192e964 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.563379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1176/2351] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:25.567475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09117bb1-ace2-4614-ab0d-15f158f70560 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.578240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09117bb1-ace2-4614-ab0d-15f158f70560 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.586931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8261e-99fc-498d-bebb-48d141224834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.588810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8261e-99fc-498d-bebb-48d141224834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.589308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8261e-99fc-498d-bebb-48d141224834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.589694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8261e-99fc-498d-bebb-48d141224834 admin admin] PATH_INFO: `/v3/projects/dae8bc1bbfc444f484f62d75be6ba342/users/64d67f4a0acc4e8bac99260d5a16e0ec/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.616956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8261e-99fc-498d-bebb-48d141224834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae8bc1bbfc444f484f62d75be6ba342, user_id=64d67f4a0acc4e8bac99260d5a16e0ec, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.620004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8261e-99fc-498d-bebb-48d141224834 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.623974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:25.624808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead1b6d-74d1-4d2f-9eb8-afb76192e964 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.626612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4ead1b6d-74d1-4d2f-9eb8-afb76192e964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.638997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1176/2352] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:25 2022] PUT /identity/v3/projects/dae8bc1bbfc444f484f62d75be6ba342/users/64d67f4a0acc4e8bac99260d5a16e0ec/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:25.648708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead1b6d-74d1-4d2f-9eb8-afb76192e964 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.656943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea5a2f-f0b0-4b12-8c8e-35b76b82124f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.657585 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea5a2f-f0b0-4b12-8c8e-35b76b82124f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.658183 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea5a2f-f0b0-4b12-8c8e-35b76b82124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.699092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-19ea5a2f-f0b0-4b12-8c8e-35b76b82124f None None] MFA Rules not processed for user `64d67f4a0acc4e8bac99260d5a16e0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:25.700573 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-19ea5a2f-f0b0-4b12-8c8e-35b76b82124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.725637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.727350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.727709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.728080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] PATH_INFO: `/v3/projects/ffafedce6a1b4dadb001f936e53d5da6` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.730024 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffafedce6a1b4dadb001f936e53d5da6)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:25.732089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:25.784393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1177/2353] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:25.791323 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:25.794240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffafedce6a1b4dadb001f936e53d5da6', 'request_id': 'req-274ea694-1493-40ef-a685-a5dcca53c4d4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.799410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea5a2f-f0b0-4b12-8c8e-35b76b82124f None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.800959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-19ea5a2f-f0b0-4b12-8c8e-35b76b82124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.804158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffafedce6a1b4dadb001f936e53d5da6', 'request_id': 'req-274ea694-1493-40ef-a685-a5dcca53c4d4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.811177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffafedce6a1b4dadb001f936e53d5da6', 'request_id': 'req-274ea694-1493-40ef-a685-a5dcca53c4d4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.826994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] The token cache is being invalidate because project ffafedce6a1b4dadb001f936e53d5da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:25.827285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.828088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-274ea694-1493-40ef-a685-a5dcca53c4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:25.829919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1177/2354] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:25 2022] DELETE /identity/v3/projects/ffafedce6a1b4dadb001f936e53d5da6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:25.839907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590109a-1b2a-4c39-986a-a80c9b4e5a23 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.840259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590109a-1b2a-4c39-986a-a80c9b4e5a23 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.840807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590109a-1b2a-4c39-986a-a80c9b4e5a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.866011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e590109a-1b2a-4c39-986a-a80c9b4e5a23 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:25.867425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e590109a-1b2a-4c39-986a-a80c9b4e5a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.875500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea5a2f-f0b0-4b12-8c8e-35b76b82124f None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:25.934666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3600b-3308-471a-a4b3-6c5537fea80f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:25.935368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3600b-3308-471a-a4b3-6c5537fea80f service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.935647 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3600b-3308-471a-a4b3-6c5537fea80f service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.935917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3600b-3308-471a-a4b3-6c5537fea80f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.937723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7ab3600b-3308-471a-a4b3-6c5537fea80f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.938553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1178/2355] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:25.948216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e178960-3551-45fd-8d8a-b1e4be37b6c1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:25.948631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e178960-3551-45fd-8d8a-b1e4be37b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:25.949008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e178960-3551-45fd-8d8a-b1e4be37b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:25.971806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8e178960-3551-45fd-8d8a-b1e4be37b6c1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:25.973052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8e178960-3551-45fd-8d8a-b1e4be37b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:25.982063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1179/2356] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:25.986261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e178960-3551-45fd-8d8a-b1e4be37b6c1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:25.998978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e178960-3551-45fd-8d8a-b1e4be37b6c1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.005575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:26.009380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf63d-80b8-4df7-8d70-85781dd7e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.009557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3600b-3308-471a-a4b3-6c5537fea80f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.009695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf63d-80b8-4df7-8d70-85781dd7e28d admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.010041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf63d-80b8-4df7-8d70-85781dd7e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.010374 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf63d-80b8-4df7-8d70-85781dd7e28d admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.011191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdf63d-80b8-4df7-8d70-85781dd7e28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:26.011671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdf63d-80b8-4df7-8d70-85781dd7e28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.013919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdf63d-80b8-4df7-8d70-85781dd7e28d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.024324 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3600b-3308-471a-a4b3-6c5537fea80f service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.033440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1180/2357] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:37:26.038297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf63d-80b8-4df7-8d70-85781dd7e28d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.043396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1178/2358] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:26.068206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf63d-80b8-4df7-8d70-85781dd7e28d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.073814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7992-0ad0-4c7c-a315-d82763b55624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.074577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7992-0ad0-4c7c-a315-d82763b55624 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.074963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7992-0ad0-4c7c-a315-d82763b55624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.075422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7992-0ad0-4c7c-a315-d82763b55624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.076194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc7992-0ad0-4c7c-a315-d82763b55624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.078492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc7992-0ad0-4c7c-a315-d82763b55624 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.125936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1181/2359] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:26 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:26.130550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3600b-3308-471a-a4b3-6c5537fea80f service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.145151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3600b-3308-471a-a4b3-6c5537fea80f service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.282322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57f2c7-9e30-435c-8fd7-01985179eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.283243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57f2c7-9e30-435c-8fd7-01985179eb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.283687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57f2c7-9e30-435c-8fd7-01985179eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.284128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57f2c7-9e30-435c-8fd7-01985179eb5d admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.284961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57f2c7-9e30-435c-8fd7-01985179eb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.287258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57f2c7-9e30-435c-8fd7-01985179eb5d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.319656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1179/2360] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:26 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:26.325057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7992-0ad0-4c7c-a315-d82763b55624 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.339812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7992-0ad0-4c7c-a315-d82763b55624 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.356095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59061bd-a5c9-4ba1-89c1-28cd70a8d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.356773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59061bd-a5c9-4ba1-89c1-28cd70a8d28f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.357563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59061bd-a5c9-4ba1-89c1-28cd70a8d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.360145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59061bd-a5c9-4ba1-89c1-28cd70a8d28f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.361026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59061bd-a5c9-4ba1-89c1-28cd70a8d28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.376718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59061bd-a5c9-4ba1-89c1-28cd70a8d28f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.400204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1182/2361] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:26.404858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57f2c7-9e30-435c-8fd7-01985179eb5d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.419115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57f2c7-9e30-435c-8fd7-01985179eb5d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.433552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b95e9-f675-44eb-b102-66475b190cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.434190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b95e9-f675-44eb-b102-66475b190cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.434454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b95e9-f675-44eb-b102-66475b190cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.434755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b95e9-f675-44eb-b102-66475b190cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.435471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b95e9-f675-44eb-b102-66475b190cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.449023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b95e9-f675-44eb-b102-66475b190cd8 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.476725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1180/2362] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:26.479532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59061bd-a5c9-4ba1-89c1-28cd70a8d28f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.505244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59061bd-a5c9-4ba1-89c1-28cd70a8d28f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.521977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302a56e-b821-410b-af80-b4cf07b0f1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.525531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302a56e-b821-410b-af80-b4cf07b0f1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.526214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302a56e-b821-410b-af80-b4cf07b0f1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.526724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302a56e-b821-410b-af80-b4cf07b0f1c6 admin admin] PATH_INFO: `/v3/projects/254a723e5f7b46bdbcea5c8e9a50734c/users/c026d9361da04b1782a78dac8f2c24e8/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.563099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302a56e-b821-410b-af80-b4cf07b0f1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254a723e5f7b46bdbcea5c8e9a50734c, user_id=c026d9361da04b1782a78dac8f2c24e8, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.579963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70eba5-1813-4eee-80d6-a82b48dd4070 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.580180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70eba5-1813-4eee-80d6-a82b48dd4070 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.580441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70eba5-1813-4eee-80d6-a82b48dd4070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.591485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302a56e-b821-410b-af80-b4cf07b0f1c6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.615871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1183/2363] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:26 2022] PUT /identity/v3/projects/254a723e5f7b46bdbcea5c8e9a50734c/users/c026d9361da04b1782a78dac8f2c24e8/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:26.621443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c392f-3f32-49c8-8176-68774fc1306c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.622211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c392f-3f32-49c8-8176-68774fc1306c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.624253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c392f-3f32-49c8-8176-68774fc1306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.629426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3e70eba5-1813-4eee-80d6-a82b48dd4070 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:26.631139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3e70eba5-1813-4eee-80d6-a82b48dd4070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:26.649419 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-384c392f-3f32-49c8-8176-68774fc1306c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:26.650646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-384c392f-3f32-49c8-8176-68774fc1306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:26.689703 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1181/2364] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:37:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:26.705465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:26.716395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1184/2365] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:26.726576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70eba5-1813-4eee-80d6-a82b48dd4070 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.728097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3e70eba5-1813-4eee-80d6-a82b48dd4070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:26.738201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c392f-3f32-49c8-8176-68774fc1306c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:26.740063 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-384c392f-3f32-49c8-8176-68774fc1306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:26.788694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70eba5-1813-4eee-80d6-a82b48dd4070 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.792235 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd45c5-936b-4027-9107-72c33d1a826b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.792841 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd45c5-936b-4027-9107-72c33d1a826b service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.793117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd45c5-936b-4027-9107-72c33d1a826b service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.793421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd45c5-936b-4027-9107-72c33d1a826b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.802632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd45c5-936b-4027-9107-72c33d1a826b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.805078 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd45c5-936b-4027-9107-72c33d1a826b service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.812395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c392f-3f32-49c8-8176-68774fc1306c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:26.815287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1182/2366] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:26.817816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1e1f-3970-4c6e-bb4f-510a313e9c95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:26.818435 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1e1f-3970-4c6e-bb4f-510a313e9c95 service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:26.818769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1e1f-3970-4c6e-bb4f-510a313e9c95 service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:26.819047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1e1f-3970-4c6e-bb4f-510a313e9c95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:26.829074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c1e1f-3970-4c6e-bb4f-510a313e9c95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:26.830992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c1e1f-3970-4c6e-bb4f-510a313e9c95 service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:26.840538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1185/2367] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:37:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 02:37:27.430827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047669-a8cd-4bd5-b0ba-c331ef131a05 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.431126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047669-a8cd-4bd5-b0ba-c331ef131a05 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.431437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047669-a8cd-4bd5-b0ba-c331ef131a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.458973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b2047669-a8cd-4bd5-b0ba-c331ef131a05 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:27.458973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b2047669-a8cd-4bd5-b0ba-c331ef131a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:27.463664 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1183/2368] 10.222.0.69 () {58 vars in 967 bytes} [Thu Aug 4 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:27.479928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1e1f-3970-4c6e-bb4f-510a313e9c95 service swift] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.492971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c1e1f-3970-4c6e-bb4f-510a313e9c95 service swift] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:27.498555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575a63-1706-4533-98eb-6b3e796cf2b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:27.499167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575a63-1706-4533-98eb-6b3e796cf2b0 service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.499445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575a63-1706-4533-98eb-6b3e796cf2b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.499701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575a63-1706-4533-98eb-6b3e796cf2b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.509838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e575a63-1706-4533-98eb-6b3e796cf2b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:27.511599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e575a63-1706-4533-98eb-6b3e796cf2b0 service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:27.520908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1186/2369] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:37:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:37:27.656146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf54cea-2b64-483a-bdf9-b6384774ed0a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.656422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf54cea-2b64-483a-bdf9-b6384774ed0a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.656702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf54cea-2b64-483a-bdf9-b6384774ed0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.740404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-dbf54cea-2b64-483a-bdf9-b6384774ed0a None None] MFA Rules not processed for user `c026d9361da04b1782a78dac8f2c24e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:27.741909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-dbf54cea-2b64-483a-bdf9-b6384774ed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:27.751532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:27.902539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1184/2370] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:27.922914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575a63-1706-4533-98eb-6b3e796cf2b0 service swift] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:27.925316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8e575a63-1706-4533-98eb-6b3e796cf2b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:27.968327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca874e84-e901-40ad-a2d7-7cf3c0bb65da None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:27.968628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca874e84-e901-40ad-a2d7-7cf3c0bb65da None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:27.968891 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca874e84-e901-40ad-a2d7-7cf3c0bb65da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:27.992354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ca874e84-e901-40ad-a2d7-7cf3c0bb65da None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:27.994070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ca874e84-e901-40ad-a2d7-7cf3c0bb65da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:28.019844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575a63-1706-4533-98eb-6b3e796cf2b0 service swift] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:28.024380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6733e-d4a4-434a-ae53-7996a8bb28bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:28.024994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6733e-d4a4-434a-ae53-7996a8bb28bf service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:28.025476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6733e-d4a4-434a-ae53-7996a8bb28bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:28.025756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6733e-d4a4-434a-ae53-7996a8bb28bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:28.027943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1185/2371] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:28.039091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca874e84-e901-40ad-a2d7-7cf3c0bb65da None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:28.049302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6733e-d4a4-434a-ae53-7996a8bb28bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:28.050808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6733e-d4a4-434a-ae53-7996a8bb28bf service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:28.052448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca874e84-e901-40ad-a2d7-7cf3c0bb65da None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:28.058478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ad8b3-c07a-404d-a140-4c437f942935 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:28.059169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ad8b3-c07a-404d-a140-4c437f942935 service swift] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:28.059449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ad8b3-c07a-404d-a140-4c437f942935 service swift] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:28.059713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ad8b3-c07a-404d-a140-4c437f942935 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:28.062000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1187/2372] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:28.071040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ad8b3-c07a-404d-a140-4c437f942935 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:28.072622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ad8b3-c07a-404d-a140-4c437f942935 service swift] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:28.083782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1186/2373] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:37:28.635297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c866-ad93-421d-b57e-5ed4efefede9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:28.635590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c866-ad93-421d-b57e-5ed4efefede9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:28.635912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c866-ad93-421d-b57e-5ed4efefede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:28.657717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9569c866-ad93-421d-b57e-5ed4efefede9 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:28.659045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9569c866-ad93-421d-b57e-5ed4efefede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:28.676359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1188/2374] 10.222.0.69 () {58 vars in 967 bytes} [Thu Aug 4 02:37:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:28.686083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ad8b3-c07a-404d-a140-4c437f942935 service swift] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:28.700171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ad8b3-c07a-404d-a140-4c437f942935 service swift] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:28.706567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dd02b-8582-4146-ba30-8ff11093c08a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:28.707498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dd02b-8582-4146-ba30-8ff11093c08a service swift] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:28.707988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dd02b-8582-4146-ba30-8ff11093c08a service swift] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:28.708455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dd02b-8582-4146-ba30-8ff11093c08a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:28.723648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69dd02b-8582-4146-ba30-8ff11093c08a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:28.725254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69dd02b-8582-4146-ba30-8ff11093c08a service swift] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:28.734900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1187/2375] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:37:29.703344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3412881-84ca-461f-99a0-fbc7dea019fc None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:29.703781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3412881-84ca-461f-99a0-fbc7dea019fc None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:29.703971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3412881-84ca-461f-99a0-fbc7dea019fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:29.726765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a3412881-84ca-461f-99a0-fbc7dea019fc None None] MFA Rules not processed for user `c026d9361da04b1782a78dac8f2c24e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:29.727964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a3412881-84ca-461f-99a0-fbc7dea019fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:29.735333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1189/2376] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:30.994489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dd02b-8582-4146-ba30-8ff11093c08a service swift] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:30.995999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f69dd02b-8582-4146-ba30-8ff11093c08a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.010458 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dd02b-8582-4146-ba30-8ff11093c08a service swift] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:31.015013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:31.015675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.015953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.016226 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] PATH_INFO: `/v3/users/0f027255e9614ef88f134b7c385f36d7` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.017454 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f027255e9614ef88f134b7c385f36d7)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:31.019431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:31.072566 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f027255e9614ef88f134b7c385f36d7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.080117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f027255e9614ef88f134b7c385f36d7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.087249 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f027255e9614ef88f134b7c385f36d7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.087908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f027255e9614ef88f134b7c385f36d7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.100174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f027255e9614ef88f134b7c385f36d7'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.107040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1188/2377] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:30 2022] DELETE /identity/v3/users/0f027255e9614ef88f134b7c385f36d7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:31.111950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6b8fe-7821-41d7-96cd-6876ad70b173 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.112877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6b8fe-7821-41d7-96cd-6876ad70b173 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.113648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6b8fe-7821-41d7-96cd-6876ad70b173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.137361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f9a6b8fe-7821-41d7-96cd-6876ad70b173 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:31.138818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f9a6b8fe-7821-41d7-96cd-6876ad70b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.210543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1190/2378] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:31.221954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:31.223409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.278455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:31.291847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ea63f-b9b1-4c8f-8b20-c69eab58f249 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:31.296192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94007dc-d573-46fc-a11b-485dff6c6873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:31.296807 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94007dc-d573-46fc-a11b-485dff6c6873 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.297092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94007dc-d573-46fc-a11b-485dff6c6873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.297391 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94007dc-d573-46fc-a11b-485dff6c6873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.307904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94007dc-d573-46fc-a11b-485dff6c6873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:31.309357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94007dc-d573-46fc-a11b-485dff6c6873 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:31.322607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1189/2379] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:31.546401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6b8fe-7821-41d7-96cd-6876ad70b173 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:31.547940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f9a6b8fe-7821-41d7-96cd-6876ad70b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.561506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6b8fe-7821-41d7-96cd-6876ad70b173 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:31.566406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:31.567045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.567325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.567601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] PATH_INFO: `/v3/projects/76ef05de5862494999c2c38ba70d54a4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.568773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ef05de5862494999c2c38ba70d54a4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:31.570951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:31.572551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:31.619772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ef05de5862494999c2c38ba70d54a4', 'request_id': 'req-578660aa-0cb7-4cb0-84b7-c35a320bbed7'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.626269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ef05de5862494999c2c38ba70d54a4', 'request_id': 'req-578660aa-0cb7-4cb0-84b7-c35a320bbed7'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.632003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ef05de5862494999c2c38ba70d54a4', 'request_id': 'req-578660aa-0cb7-4cb0-84b7-c35a320bbed7'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.642651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] The token cache is being invalidate because project 76ef05de5862494999c2c38ba70d54a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:31.652294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.652294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-578660aa-0cb7-4cb0-84b7-c35a320bbed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:31.652294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1191/2380] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:31 2022] DELETE /identity/v3/projects/76ef05de5862494999c2c38ba70d54a4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:31.653134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170f43-d087-44c1-88b7-5fd1cc2ee452 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.653134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170f43-d087-44c1-88b7-5fd1cc2ee452 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.653134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170f43-d087-44c1-88b7-5fd1cc2ee452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.670412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-84170f43-d087-44c1-88b7-5fd1cc2ee452 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:31.671602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-84170f43-d087-44c1-88b7-5fd1cc2ee452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.729213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1190/2381] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:31.737011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44739379-fcb6-454f-9c81-8c926d087d3e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.737300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44739379-fcb6-454f-9c81-8c926d087d3e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.737641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44739379-fcb6-454f-9c81-8c926d087d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.758096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-44739379-fcb6-454f-9c81-8c926d087d3e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:31.759293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-44739379-fcb6-454f-9c81-8c926d087d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.767170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1192/2382] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:31.771349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170f43-d087-44c1-88b7-5fd1cc2ee452 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:31.781917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170f43-d087-44c1-88b7-5fd1cc2ee452 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:31.786602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a954c0f-e48c-43ee-b80c-0ddc15a7acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:31.787327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954c0f-e48c-43ee-b80c-0ddc15a7acea admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.787615 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954c0f-e48c-43ee-b80c-0ddc15a7acea admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.787950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954c0f-e48c-43ee-b80c-0ddc15a7acea admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.788739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a954c0f-e48c-43ee-b80c-0ddc15a7acea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:31.789041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a954c0f-e48c-43ee-b80c-0ddc15a7acea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:31.790676 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a954c0f-e48c-43ee-b80c-0ddc15a7acea admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:31.803822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1191/2383] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:37:31.808231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44739379-fcb6-454f-9c81-8c926d087d3e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:31.818035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44739379-fcb6-454f-9c81-8c926d087d3e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:31.823189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ff600-839b-4f62-be19-d35cfd3c5c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:31.823799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff600-839b-4f62-be19-d35cfd3c5c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.824079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff600-839b-4f62-be19-d35cfd3c5c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.824351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff600-839b-4f62-be19-d35cfd3c5c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.825008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ff600-839b-4f62-be19-d35cfd3c5c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:31.827026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ff600-839b-4f62-be19-d35cfd3c5c3f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:31.855642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1193/2384] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:31 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:31.859667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a954c0f-e48c-43ee-b80c-0ddc15a7acea admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:31.869879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a954c0f-e48c-43ee-b80c-0ddc15a7acea admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:31.927256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0625e-7957-4969-94c4-8462d8009153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:31.927878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0625e-7957-4969-94c4-8462d8009153 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.928161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0625e-7957-4969-94c4-8462d8009153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.928485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0625e-7957-4969-94c4-8462d8009153 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.929188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0625e-7957-4969-94c4-8462d8009153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:31.931144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0625e-7957-4969-94c4-8462d8009153 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:31.953084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1192/2385] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:31 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:31.957178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ff600-839b-4f62-be19-d35cfd3c5c3f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:31.968376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ff600-839b-4f62-be19-d35cfd3c5c3f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:31.972992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88c8f0-343f-4905-8005-a4b6a070a4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:31.973718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88c8f0-343f-4905-8005-a4b6a070a4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:31.974005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88c8f0-343f-4905-8005-a4b6a070a4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:31.974285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88c8f0-343f-4905-8005-a4b6a070a4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:31.975061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88c8f0-343f-4905-8005-a4b6a070a4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:31.976692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88c8f0-343f-4905-8005-a4b6a070a4a7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:31.980362 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0625e-7957-4969-94c4-8462d8009153 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:31.982079 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c9b0625e-7957-4969-94c4-8462d8009153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:31.989885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1194/2386] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:31.990912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88c8f0-343f-4905-8005-a4b6a070a4a7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:31.995329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0625e-7957-4969-94c4-8462d8009153 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:32.000101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:32.000416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88c8f0-343f-4905-8005-a4b6a070a4a7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:32.000731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.001016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.001285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] PATH_INFO: `/v3/users/64d67f4a0acc4e8bac99260d5a16e0ec` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.002471 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d67f4a0acc4e8bac99260d5a16e0ec)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:32.004363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:32.005691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeceee-6f74-4dae-88ff-d0599db781cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:32.006387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeceee-6f74-4dae-88ff-d0599db781cc admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.007197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeceee-6f74-4dae-88ff-d0599db781cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.007473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeceee-6f74-4dae-88ff-d0599db781cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.008204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdeceee-6f74-4dae-88ff-d0599db781cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:32.009922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdeceee-6f74-4dae-88ff-d0599db781cc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:32.020018 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1195/2387] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:32.024633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeceee-6f74-4dae-88ff-d0599db781cc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:32.034649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeceee-6f74-4dae-88ff-d0599db781cc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:32.039571 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83d012-0be8-422c-954e-9065ebd71c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:32.040291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83d012-0be8-422c-954e-9065ebd71c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.040590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83d012-0be8-422c-954e-9065ebd71c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.040860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83d012-0be8-422c-954e-9065ebd71c33 admin admin] PATH_INFO: `/v3/projects/6d2b00bab367473199ed7c29ad5493f8/users/886527dcd4364610a2eba1eb2df3f3ce/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.056413 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d67f4a0acc4e8bac99260d5a16e0ec'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.056653 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83d012-0be8-422c-954e-9065ebd71c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2b00bab367473199ed7c29ad5493f8, user_id=886527dcd4364610a2eba1eb2df3f3ce, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:32.059572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83d012-0be8-422c-954e-9065ebd71c33 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:32.069919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d67f4a0acc4e8bac99260d5a16e0ec'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.074775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:32.077589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d67f4a0acc4e8bac99260d5a16e0ec'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.078325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d67f4a0acc4e8bac99260d5a16e0ec'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.080078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1196/2388] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:32 2022] PUT /identity/v3/projects/6d2b00bab367473199ed7c29ad5493f8/users/886527dcd4364610a2eba1eb2df3f3ce/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:32.084861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a49a00-ef47-45b3-bb98-580cbc013be1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.085144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a49a00-ef47-45b3-bb98-580cbc013be1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.085509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a49a00-ef47-45b3-bb98-580cbc013be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.097867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a95864cd-164b-4d35-8412-7d2ecc99f41c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d67f4a0acc4e8bac99260d5a16e0ec'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.103768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1193/2389] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:31 2022] DELETE /identity/v3/users/64d67f4a0acc4e8bac99260d5a16e0ec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:32.104205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-18a49a00-ef47-45b3-bb98-580cbc013be1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:32.105446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-18a49a00-ef47-45b3-bb98-580cbc013be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:32.108044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912ecdb-a7f7-45a7-9f0f-6a7ece2eea6e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.108929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912ecdb-a7f7-45a7-9f0f-6a7ece2eea6e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.109215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912ecdb-a7f7-45a7-9f0f-6a7ece2eea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.129426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-7912ecdb-a7f7-45a7-9f0f-6a7ece2eea6e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:32.131124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7912ecdb-a7f7-45a7-9f0f-6a7ece2eea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:32.173836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1197/2390] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:32.185058 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a49a00-ef47-45b3-bb98-580cbc013be1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:32.186547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-18a49a00-ef47-45b3-bb98-580cbc013be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:32.203451 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1194/2391] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:32.205855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:32.215372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912ecdb-a7f7-45a7-9f0f-6a7ece2eea6e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:32.216944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7912ecdb-a7f7-45a7-9f0f-6a7ece2eea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:32.263417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a49a00-ef47-45b3-bb98-580cbc013be1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:32.269629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea134f-6de4-4d99-b3bf-7e83c91aaf87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:32.270664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea134f-6de4-4d99-b3bf-7e83c91aaf87 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.270960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea134f-6de4-4d99-b3bf-7e83c91aaf87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.271854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea134f-6de4-4d99-b3bf-7e83c91aaf87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.285545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912ecdb-a7f7-45a7-9f0f-6a7ece2eea6e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:32.285800 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea134f-6de4-4d99-b3bf-7e83c91aaf87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:32.287051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea134f-6de4-4d99-b3bf-7e83c91aaf87 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:32.292175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fc8f0-a1ad-47cf-876f-d39f842cef48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:32.292798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fc8f0-a1ad-47cf-876f-d39f842cef48 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.293072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fc8f0-a1ad-47cf-876f-d39f842cef48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.293351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fc8f0-a1ad-47cf-876f-d39f842cef48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.297373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1198/2392] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:32.309935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fc8f0-a1ad-47cf-876f-d39f842cef48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:32.312052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fc8f0-a1ad-47cf-876f-d39f842cef48 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:32.322575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1195/2393] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:32.359300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea134f-6de4-4d99-b3bf-7e83c91aaf87 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:32.361289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cfea134f-6de4-4d99-b3bf-7e83c91aaf87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:32.376901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea134f-6de4-4d99-b3bf-7e83c91aaf87 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:32.385817 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:32.386721 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.387143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.387723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] PATH_INFO: `/v3/users/34a23ede3883445ba2744a1660038746` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.389094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a23ede3883445ba2744a1660038746)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:32.391137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:32.449657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a23ede3883445ba2744a1660038746'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.460745 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a23ede3883445ba2744a1660038746'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.470984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a23ede3883445ba2744a1660038746'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.471896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a23ede3883445ba2744a1660038746'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.472792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a23ede3883445ba2744a1660038746'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.499680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1199/2394] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:32 2022] DELETE /identity/v3/users/34a23ede3883445ba2744a1660038746 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:32.503834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15450322-1cf8-42ca-9677-6c4b25d9876d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.504191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15450322-1cf8-42ca-9677-6c4b25d9876d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.504556 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15450322-1cf8-42ca-9677-6c4b25d9876d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.545419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-15450322-1cf8-42ca-9677-6c4b25d9876d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:32.547056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-15450322-1cf8-42ca-9677-6c4b25d9876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:32.672946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1196/2395] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:32.694986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:32.699989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:32.830312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15450322-1cf8-42ca-9677-6c4b25d9876d None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:32.832075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-15450322-1cf8-42ca-9677-6c4b25d9876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:32.846317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15450322-1cf8-42ca-9677-6c4b25d9876d None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:32.854762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:32.855494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.855769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.856038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] PATH_INFO: `/v3/projects/dae8bc1bbfc444f484f62d75be6ba342` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.859764 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae8bc1bbfc444f484f62d75be6ba342)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:32.862052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:32.868901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09af5c-1262-4fe6-b16d-6e7319ceef01 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:32.878338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f736352-7773-4b6f-a890-d11c74006e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:32.879585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f736352-7773-4b6f-a890-d11c74006e36 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:32.880286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f736352-7773-4b6f-a890-d11c74006e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:32.880609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f736352-7773-4b6f-a890-d11c74006e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:32.901205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:32.906835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f736352-7773-4b6f-a890-d11c74006e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:32.909902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f736352-7773-4b6f-a890-d11c74006e36 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:32.924117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1200/2396] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:32.961290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae8bc1bbfc444f484f62d75be6ba342', 'request_id': 'req-3c276127-1324-41cd-b274-aca8c99885c4'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.977307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae8bc1bbfc444f484f62d75be6ba342', 'request_id': 'req-3c276127-1324-41cd-b274-aca8c99885c4'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:32.992071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae8bc1bbfc444f484f62d75be6ba342', 'request_id': 'req-3c276127-1324-41cd-b274-aca8c99885c4'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.012590 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] The token cache is being invalidate because project dae8bc1bbfc444f484f62d75be6ba342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:33.013265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.015164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3c276127-1324-41cd-b274-aca8c99885c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.016751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1197/2397] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:32 2022] DELETE /identity/v3/projects/dae8bc1bbfc444f484f62d75be6ba342 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:33.022643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669fd3b-9b89-48f3-8971-1091aaf67fd0 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.023499 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669fd3b-9b89-48f3-8971-1091aaf67fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.024316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669fd3b-9b89-48f3-8971-1091aaf67fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.056367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a669fd3b-9b89-48f3-8971-1091aaf67fd0 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:33.056367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a669fd3b-9b89-48f3-8971-1091aaf67fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:33.107507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:33.148830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1201/2398] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:33.156632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18847d24-8669-4979-b2b7-f212a0beecfa None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.157420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18847d24-8669-4979-b2b7-f212a0beecfa None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.157882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18847d24-8669-4979-b2b7-f212a0beecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.203532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-18847d24-8669-4979-b2b7-f212a0beecfa None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:33.205043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-18847d24-8669-4979-b2b7-f212a0beecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:33.214790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1198/2399] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:33.219315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669fd3b-9b89-48f3-8971-1091aaf67fd0 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.232829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669fd3b-9b89-48f3-8971-1091aaf67fd0 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.239089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.239781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.240062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.240333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.241124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:33.241392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.243149 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.262181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1202/2400] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:37:33.263937 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18847d24-8669-4979-b2b7-f212a0beecfa None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.279591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18847d24-8669-4979-b2b7-f212a0beecfa None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.286748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17b625-cc76-451a-934f-e2b4a212e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.287477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17b625-cc76-451a-934f-e2b4a212e992 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.287861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17b625-cc76-451a-934f-e2b4a212e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.288320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17b625-cc76-451a-934f-e2b4a212e992 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.326146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17b625-cc76-451a-934f-e2b4a212e992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.338057 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17b625-cc76-451a-934f-e2b4a212e992 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.357360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.360957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:33.379922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaa902-7a28-41d5-9099-afa96d1061ca admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.391047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.391863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.392181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.392463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] PATH_INFO: `/v3/projects/d84c6fedd7b0423eba336d6643985684` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.394463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84c6fedd7b0423eba336d6643985684)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.399762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.407943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1199/2401] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:33 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:33.414946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17b625-cc76-451a-934f-e2b4a212e992 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.488109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84c6fedd7b0423eba336d6643985684', 'request_id': 'req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.498392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84c6fedd7b0423eba336d6643985684', 'request_id': 'req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.510966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84c6fedd7b0423eba336d6643985684', 'request_id': 'req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.531095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17b625-cc76-451a-934f-e2b4a212e992 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.546117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] The token cache is being invalidate because project d84c6fedd7b0423eba336d6643985684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:33.547101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.548890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-419d2ebc-f7f6-4d47-b1d1-da4f92aa9224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:33.550901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1203/2402] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:33 2022] DELETE /identity/v3/projects/d84c6fedd7b0423eba336d6643985684 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:33.563361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9890-c69c-4e6f-a17e-0a246887bea9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.564065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9890-c69c-4e6f-a17e-0a246887bea9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.565316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9890-c69c-4e6f-a17e-0a246887bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.605488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-091b9890-c69c-4e6f-a17e-0a246887bea9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:33.606277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-091b9890-c69c-4e6f-a17e-0a246887bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:33.606743 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ecbf0-9710-469c-817e-4d4dcfea7fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.607440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ecbf0-9710-469c-817e-4d4dcfea7fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.607786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ecbf0-9710-469c-817e-4d4dcfea7fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.608547 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ecbf0-9710-469c-817e-4d4dcfea7fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.608873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ecbf0-9710-469c-817e-4d4dcfea7fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.611034 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ecbf0-9710-469c-817e-4d4dcfea7fa0 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.614997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1204/2403] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:33.623620 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88df6c-40cd-47d0-9327-918db3eb9727 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.623976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88df6c-40cd-47d0-9327-918db3eb9727 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.624328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88df6c-40cd-47d0-9327-918db3eb9727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.646430 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1200/2404] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:33 2022] POST /identity/v3/users => generated 283 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:37:33.647772 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ecbf0-9710-469c-817e-4d4dcfea7fa0 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.652536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-520ecbf0-9710-469c-817e-4d4dcfea7fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:33.656430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1d88df6c-40cd-47d0-9327-918db3eb9727 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:33.657631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1d88df6c-40cd-47d0-9327-918db3eb9727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:33.668932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ecbf0-9710-469c-817e-4d4dcfea7fa0 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.672805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1205/2405] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:33.678199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88df6c-40cd-47d0-9327-918db3eb9727 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.682239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7223d-ed5b-4720-b84f-4a0866856321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.683075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7223d-ed5b-4720-b84f-4a0866856321 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.683564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7223d-ed5b-4720-b84f-4a0866856321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.683710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7223d-ed5b-4720-b84f-4a0866856321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.684443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7223d-ed5b-4720-b84f-4a0866856321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.686511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7223d-ed5b-4720-b84f-4a0866856321 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.693518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:33.699094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88df6c-40cd-47d0-9327-918db3eb9727 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.706056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1201/2406] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:33.707043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7223d-ed5b-4720-b84f-4a0866856321 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.707535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf4f41-3a06-4bb4-8b7c-61f9584b2e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.708244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf4f41-3a06-4bb4-8b7c-61f9584b2e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.708658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf4f41-3a06-4bb4-8b7c-61f9584b2e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.708978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf4f41-3a06-4bb4-8b7c-61f9584b2e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.710087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf4f41-3a06-4bb4-8b7c-61f9584b2e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:37:33.710343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf4f41-3a06-4bb4-8b7c-61f9584b2e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.713065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf4f41-3a06-4bb4-8b7c-61f9584b2e09 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.727901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7223d-ed5b-4720-b84f-4a0866856321 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.735427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853218-b541-4870-b377-48e01a594596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.736707 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853218-b541-4870-b377-48e01a594596 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.737002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853218-b541-4870-b377-48e01a594596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.737647 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df853218-b541-4870-b377-48e01a594596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.738477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df853218-b541-4870-b377-48e01a594596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.740576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df853218-b541-4870-b377-48e01a594596 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.744076 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1206/2407] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:37:33.748903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf4f41-3a06-4bb4-8b7c-61f9584b2e09 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.771766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1202/2408] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:33.772930 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853218-b541-4870-b377-48e01a594596 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.775129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf4f41-3a06-4bb4-8b7c-61f9584b2e09 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.782722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da07aa-2639-44c9-8f4d-a5855b3bfcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.784849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da07aa-2639-44c9-8f4d-a5855b3bfcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.785288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da07aa-2639-44c9-8f4d-a5855b3bfcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.785889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da07aa-2639-44c9-8f4d-a5855b3bfcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.786623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df853218-b541-4870-b377-48e01a594596 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:33.787726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da07aa-2639-44c9-8f4d-a5855b3bfcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.790284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da07aa-2639-44c9-8f4d-a5855b3bfcf2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.792102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87437f-938c-46b7-a612-6aed45a094f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:33.793098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87437f-938c-46b7-a612-6aed45a094f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.793411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87437f-938c-46b7-a612-6aed45a094f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.793690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87437f-938c-46b7-a612-6aed45a094f2 admin admin] PATH_INFO: `/v3/projects/22ad94576bd84563ba3d196aa6d441bb/users/fe33b0e819b94ddab9193a3379fd609f/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.815860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87437f-938c-46b7-a612-6aed45a094f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ad94576bd84563ba3d196aa6d441bb, user_id=fe33b0e819b94ddab9193a3379fd609f, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:33.819955 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87437f-938c-46b7-a612-6aed45a094f2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:33.841723 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1203/2409] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:33 2022] PUT /identity/v3/projects/22ad94576bd84563ba3d196aa6d441bb/users/fe33b0e819b94ddab9193a3379fd609f/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:33.855083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae710-5764-455a-86a8-dd20294014ec None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:33.855367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae710-5764-455a-86a8-dd20294014ec None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:33.855684 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae710-5764-455a-86a8-dd20294014ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:33.868023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1207/2410] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:33 2022] POST /identity/v3/projects => generated 397 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:33.870777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da07aa-2639-44c9-8f4d-a5855b3bfcf2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:33.921796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ee0ae710-5764-455a-86a8-dd20294014ec None None] MFA Rules not processed for user `fe33b0e819b94ddab9193a3379fd609f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:33.923569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ee0ae710-5764-455a-86a8-dd20294014ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:34.011292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:34.022934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da07aa-2639-44c9-8f4d-a5855b3bfcf2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:34.026031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1204/2411] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:34.040469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae710-5764-455a-86a8-dd20294014ec None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:34.042983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32418bd9-5705-4576-93a5-e42e5533194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:34.044703 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ee0ae710-5764-455a-86a8-dd20294014ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:34.044839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418bd9-5705-4576-93a5-e42e5533194f admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:34.045013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418bd9-5705-4576-93a5-e42e5533194f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:34.045505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32418bd9-5705-4576-93a5-e42e5533194f admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:34.046412 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32418bd9-5705-4576-93a5-e42e5533194f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:34.051594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32418bd9-5705-4576-93a5-e42e5533194f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:34.135469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1208/2412] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:33 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:34.139416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32418bd9-5705-4576-93a5-e42e5533194f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:34.145832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae710-5764-455a-86a8-dd20294014ec None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:34.150765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471be7df-47ac-488a-a300-cc0a76d688a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:34.151551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471be7df-47ac-488a-a300-cc0a76d688a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:34.152272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471be7df-47ac-488a-a300-cc0a76d688a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:34.152272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471be7df-47ac-488a-a300-cc0a76d688a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:34.161575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32418bd9-5705-4576-93a5-e42e5533194f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:34.163836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471be7df-47ac-488a-a300-cc0a76d688a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:34.165971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471be7df-47ac-488a-a300-cc0a76d688a2 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:34.169741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6af02-eb02-47bf-a714-0730a337d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:34.170847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6af02-eb02-47bf-a714-0730a337d670 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:34.171383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6af02-eb02-47bf-a714-0730a337d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:34.171838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6af02-eb02-47bf-a714-0730a337d670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:34.173322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6af02-eb02-47bf-a714-0730a337d670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:34.175659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6af02-eb02-47bf-a714-0730a337d670 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:34.180421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1205/2413] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:34.190431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1209/2414] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:37:34.194167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471be7df-47ac-488a-a300-cc0a76d688a2 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:34.210092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471be7df-47ac-488a-a300-cc0a76d688a2 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:34.214980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fd50b-7b1e-48dd-b81d-b0be6d0ff66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:34.215906 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fd50b-7b1e-48dd-b81d-b0be6d0ff66a admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:34.216192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fd50b-7b1e-48dd-b81d-b0be6d0ff66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:34.216539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fd50b-7b1e-48dd-b81d-b0be6d0ff66a admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:34.217244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fd50b-7b1e-48dd-b81d-b0be6d0ff66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:34.219341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fd50b-7b1e-48dd-b81d-b0be6d0ff66a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:34.232107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1206/2415] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:34.236842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6af02-eb02-47bf-a714-0730a337d670 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:34.251305 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6af02-eb02-47bf-a714-0730a337d670 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:34.257743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948af0f-b589-47cd-aaf2-8ea327bca4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:34.258658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948af0f-b589-47cd-aaf2-8ea327bca4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:34.260108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948af0f-b589-47cd-aaf2-8ea327bca4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:34.260571 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948af0f-b589-47cd-aaf2-8ea327bca4b2 admin admin] PATH_INFO: `/v3/projects/83156b8f5a9f4d8281be6887457f663e/users/dabd283ce19e459b80f249a4af844dac/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:34.284895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948af0f-b589-47cd-aaf2-8ea327bca4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83156b8f5a9f4d8281be6887457f663e, user_id=dabd283ce19e459b80f249a4af844dac, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:34.290244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948af0f-b589-47cd-aaf2-8ea327bca4b2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:34.318137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1210/2416] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:34 2022] PUT /identity/v3/projects/83156b8f5a9f4d8281be6887457f663e/users/dabd283ce19e459b80f249a4af844dac/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:37:34.327716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1d82-7bbb-47c5-83f4-1e0450d405f4 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:34.328015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1d82-7bbb-47c5-83f4-1e0450d405f4 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:34.328769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1d82-7bbb-47c5-83f4-1e0450d405f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:34.392668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4ceb1d82-7bbb-47c5-83f4-1e0450d405f4 None None] MFA Rules not processed for user `dabd283ce19e459b80f249a4af844dac`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:34.394231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4ceb1d82-7bbb-47c5-83f4-1e0450d405f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:34.500851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:34.623208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1207/2417] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:34.640365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948af0f-b589-47cd-aaf2-8ea327bca4b2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:34.644824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c948af0f-b589-47cd-aaf2-8ea327bca4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:34.783314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948af0f-b589-47cd-aaf2-8ea327bca4b2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:34.798713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9bf4b-4fa5-4cd6-944e-479a81dafd2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:34.799892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9bf4b-4fa5-4cd6-944e-479a81dafd2f service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:34.800382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9bf4b-4fa5-4cd6-944e-479a81dafd2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:34.800834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9bf4b-4fa5-4cd6-944e-479a81dafd2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:34.822268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9bf4b-4fa5-4cd6-944e-479a81dafd2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:34.823446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9bf4b-4fa5-4cd6-944e-479a81dafd2f service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:34.836676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1211/2418] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:40.060956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92afeb-f898-4743-a7e7-16ffc71a1ddd None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.061545 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92afeb-f898-4743-a7e7-16ffc71a1ddd None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.061814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92afeb-f898-4743-a7e7-16ffc71a1ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.105449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-fa92afeb-f898-4743-a7e7-16ffc71a1ddd None None] MFA Rules not processed for user `886527dcd4364610a2eba1eb2df3f3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:40.105449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fa92afeb-f898-4743-a7e7-16ffc71a1ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:40.181573 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1208/2419] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:40.186103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9bf4b-4fa5-4cd6-944e-479a81dafd2f service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.188369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-beb9bf4b-4fa5-4cd6-944e-479a81dafd2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:40.259656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9bf4b-4fa5-4cd6-944e-479a81dafd2f service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.264478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be18796-8a6b-49c8-9299-affa5cecf136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.265137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18796-8a6b-49c8-9299-affa5cecf136 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.265450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18796-8a6b-49c8-9299-affa5cecf136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.265726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18796-8a6b-49c8-9299-affa5cecf136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.266391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be18796-8a6b-49c8-9299-affa5cecf136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.268543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be18796-8a6b-49c8-9299-affa5cecf136 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.308109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1212/2420] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:37:40 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:40.312006 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92afeb-f898-4743-a7e7-16ffc71a1ddd None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.332775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92afeb-f898-4743-a7e7-16ffc71a1ddd None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.412778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd0bbc-35ed-4bf8-b423-b4f8b5eda99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.413949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd0bbc-35ed-4bf8-b423-b4f8b5eda99f admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.415250 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd0bbc-35ed-4bf8-b423-b4f8b5eda99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.415639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd0bbc-35ed-4bf8-b423-b4f8b5eda99f admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.416542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd0bbc-35ed-4bf8-b423-b4f8b5eda99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.419329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd0bbc-35ed-4bf8-b423-b4f8b5eda99f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.424813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be18796-8a6b-49c8-9299-affa5cecf136 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.440306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be18796-8a6b-49c8-9299-affa5cecf136 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.448112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.448751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.449045 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.449407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] PATH_INFO: `/v3/users/dabd283ce19e459b80f249a4af844dac` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.451103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabd283ce19e459b80f249a4af844dac)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.453396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.486946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1209/2421] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:37:40 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:37:40.489299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd0bbc-35ed-4bf8-b423-b4f8b5eda99f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.514268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd0bbc-35ed-4bf8-b423-b4f8b5eda99f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.524920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2b2d-6dc5-4367-944e-87e21a3c0a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.525968 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2b2d-6dc5-4367-944e-87e21a3c0a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.529748 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2b2d-6dc5-4367-944e-87e21a3c0a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.532026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2b2d-6dc5-4367-944e-87e21a3c0a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.535340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce2b2d-6dc5-4367-944e-87e21a3c0a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.539115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce2b2d-6dc5-4367-944e-87e21a3c0a44 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.559558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:40.572253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabd283ce19e459b80f249a4af844dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:40.601124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabd283ce19e459b80f249a4af844dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:40.603256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1210/2422] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:40.610055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2b2d-6dc5-4367-944e-87e21a3c0a44 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.630011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabd283ce19e459b80f249a4af844dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:40.635769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2b2d-6dc5-4367-944e-87e21a3c0a44 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.645054 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabd283ce19e459b80f249a4af844dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:40.647485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-69249eab-581a-46b7-ac6e-10c29b9e0aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabd283ce19e459b80f249a4af844dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:40.649902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dcde9-6855-4396-b8c0-94c4c74dc374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.650594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dcde9-6855-4396-b8c0-94c4c74dc374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.650881 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dcde9-6855-4396-b8c0-94c4c74dc374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.651273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dcde9-6855-4396-b8c0-94c4c74dc374 admin admin] PATH_INFO: `/v3/projects/cc66f7ea62d144ad8657a328f42be42f/users/5ddd3205277a40d48174f606ecb4cfe0/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.683219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dcde9-6855-4396-b8c0-94c4c74dc374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc66f7ea62d144ad8657a328f42be42f, user_id=5ddd3205277a40d48174f606ecb4cfe0, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.684303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1213/2423] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:37:40 2022] DELETE /identity/v3/users/dabd283ce19e459b80f249a4af844dac => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:40.687942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe525e9-9c70-4ed3-b3fe-f4bce20b851a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.688322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe525e9-9c70-4ed3-b3fe-f4bce20b851a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.690465 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe525e9-9c70-4ed3-b3fe-f4bce20b851a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.691115 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dcde9-6855-4396-b8c0-94c4c74dc374 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.720824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9fe525e9-9c70-4ed3-b3fe-f4bce20b851a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:40.721214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1211/2424] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:40 2022] PUT /identity/v3/projects/cc66f7ea62d144ad8657a328f42be42f/users/5ddd3205277a40d48174f606ecb4cfe0/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:40.722495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9fe525e9-9c70-4ed3-b3fe-f4bce20b851a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:40.722994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dcde9-6855-4396-b8c0-94c4c74dc374 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.725804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-059dcde9-6855-4396-b8c0-94c4c74dc374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:40.780228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:40.933099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dcde9-6855-4396-b8c0-94c4c74dc374 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.933099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469c673-436d-4f4e-b186-565eb48abdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.933099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469c673-436d-4f4e-b186-565eb48abdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.933099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469c673-436d-4f4e-b186-565eb48abdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.934124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469c673-436d-4f4e-b186-565eb48abdf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:40.934124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469c673-436d-4f4e-b186-565eb48abdf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:40.934124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469c673-436d-4f4e-b186-565eb48abdf9 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:40.953928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1212/2425] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:37:40.954780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469c673-436d-4f4e-b186-565eb48abdf9 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.979835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1214/2426] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:37:40.980210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469c673-436d-4f4e-b186-565eb48abdf9 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:40.989122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe525e9-9c70-4ed3-b3fe-f4bce20b851a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:40.992019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9fe525e9-9c70-4ed3-b3fe-f4bce20b851a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:40.995431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589d31a-98b6-42fc-8279-6977a040540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:40.998887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589d31a-98b6-42fc-8279-6977a040540b admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:40.999172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589d31a-98b6-42fc-8279-6977a040540b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:40.999453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589d31a-98b6-42fc-8279-6977a040540b admin admin] PATH_INFO: `/v3/projects/cc66f7ea62d144ad8657a328f42be42f/users/5ddd3205277a40d48174f606ecb4cfe0/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:41.004366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589d31a-98b6-42fc-8279-6977a040540b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc66f7ea62d144ad8657a328f42be42f, user_id=5ddd3205277a40d48174f606ecb4cfe0, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:41.008340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1589d31a-98b6-42fc-8279-6977a040540b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:41.041282 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1213/2427] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:37:40 2022] PUT /identity/v3/projects/cc66f7ea62d144ad8657a328f42be42f/users/5ddd3205277a40d48174f606ecb4cfe0/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:41.167326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe525e9-9c70-4ed3-b3fe-f4bce20b851a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:41.252356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee74da-da30-486e-a017-248b65e0a057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:41.253134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee74da-da30-486e-a017-248b65e0a057 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:41.254040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee74da-da30-486e-a017-248b65e0a057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:41.254856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee74da-da30-486e-a017-248b65e0a057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:41.279931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:41.373426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee74da-da30-486e-a017-248b65e0a057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:41.375664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee74da-da30-486e-a017-248b65e0a057 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:41.389643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1215/2428] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:37:42.248064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589d31a-98b6-42fc-8279-6977a040540b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:42.250156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1589d31a-98b6-42fc-8279-6977a040540b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:42.321492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589d31a-98b6-42fc-8279-6977a040540b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:42.335535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:42.337447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:42.339425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:42.339881 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] PATH_INFO: `/v3/projects/83156b8f5a9f4d8281be6887457f663e` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:42.344285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83156b8f5a9f4d8281be6887457f663e)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:42.351107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:42.582178 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83156b8f5a9f4d8281be6887457f663e', 'request_id': 'req-274167ac-55a3-492e-aa65-218518bba7d0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:42.606142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83156b8f5a9f4d8281be6887457f663e', 'request_id': 'req-274167ac-55a3-492e-aa65-218518bba7d0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:42.626914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83156b8f5a9f4d8281be6887457f663e', 'request_id': 'req-274167ac-55a3-492e-aa65-218518bba7d0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:42.673038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] The token cache is being invalidate because project 83156b8f5a9f4d8281be6887457f663e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:37:42.673340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:42.679365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:37:42.684416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1214/2429] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:37:42 2022] DELETE /identity/v3/projects/83156b8f5a9f4d8281be6887457f663e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:37:43.945982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc29a6-1926-4e38-a1e9-70e89e2e22dc None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:43.946589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc29a6-1926-4e38-a1e9-70e89e2e22dc None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:43.946589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc29a6-1926-4e38-a1e9-70e89e2e22dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:43.978706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e0cc29a6-1926-4e38-a1e9-70e89e2e22dc None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:43.979930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e0cc29a6-1926-4e38-a1e9-70e89e2e22dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:44.148993 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1216/2430] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:44.169890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:44.172706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:44.291029 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274167ac-55a3-492e-aa65-218518bba7d0 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:44.298165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddcf4b-04eb-41b9-8360-219ac705bb57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:44.299089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddcf4b-04eb-41b9-8360-219ac705bb57 service swift] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:44.299867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddcf4b-04eb-41b9-8360-219ac705bb57 service swift] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:44.300482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddcf4b-04eb-41b9-8360-219ac705bb57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:44.315016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddcf4b-04eb-41b9-8360-219ac705bb57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:44.316894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddcf4b-04eb-41b9-8360-219ac705bb57 service swift] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:44.346036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1215/2431] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:37:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:37:47.253470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b67b49-d2ea-4398-abb6-a16c46d61026 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:47.254873 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b67b49-d2ea-4398-abb6-a16c46d61026 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:47.255415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b67b49-d2ea-4398-abb6-a16c46d61026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:47.307195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-09b67b49-d2ea-4398-abb6-a16c46d61026 None None] MFA Rules not processed for user `7be58892888f468d9caaeec9f02c5fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:47.308421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-09b67b49-d2ea-4398-abb6-a16c46d61026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:47.395345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1217/2432] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:50.043895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3648-1bac-4237-9960-e9f124c7bb8e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.045609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3648-1bac-4237-9960-e9f124c7bb8e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.045926 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3648-1bac-4237-9960-e9f124c7bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.106706 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-98df3648-1bac-4237-9960-e9f124c7bb8e None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:50.108203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-98df3648-1bac-4237-9960-e9f124c7bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:50.138934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1216/2433] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:37:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:50.150921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b67b49-d2ea-4398-abb6-a16c46d61026 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:50.167691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b67b49-d2ea-4398-abb6-a16c46d61026 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:50.175430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7adf21-7056-4868-924f-0523ba529b00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:50.176457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7adf21-7056-4868-924f-0523ba529b00 service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:50.176911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7adf21-7056-4868-924f-0523ba529b00 service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:50.178102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7adf21-7056-4868-924f-0523ba529b00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:50.198201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7adf21-7056-4868-924f-0523ba529b00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:50.200247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7adf21-7056-4868-924f-0523ba529b00 service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:50.210786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1218/2434] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:37:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:37:51.497060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f03a05-bd6b-4246-ab17-a070931826d7 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:51.497674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f03a05-bd6b-4246-ab17-a070931826d7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:51.498052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f03a05-bd6b-4246-ab17-a070931826d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:51.578647 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:51.604972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-75f03a05-bd6b-4246-ab17-a070931826d7 None None] MFA Rules not processed for user `5ddd3205277a40d48174f606ecb4cfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:51.607132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-75f03a05-bd6b-4246-ab17-a070931826d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:51.905276 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1217/2435] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:37:51.920791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7adf21-7056-4868-924f-0523ba529b00 service swift] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:37:51.922353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1f7adf21-7056-4868-924f-0523ba529b00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:52.118818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:37:52.184486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7adf21-7056-4868-924f-0523ba529b00 service swift] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:37:52.199362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a670cbc-f3ad-49ab-92ca-95ac56d49c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:37:52.200127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670cbc-f3ad-49ab-92ca-95ac56d49c5a service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:52.201924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670cbc-f3ad-49ab-92ca-95ac56d49c5a service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:52.201924 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670cbc-f3ad-49ab-92ca-95ac56d49c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:52.208108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6a670cbc-f3ad-49ab-92ca-95ac56d49c5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:52.390913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a670cbc-f3ad-49ab-92ca-95ac56d49c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:37:52.394772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a670cbc-f3ad-49ab-92ca-95ac56d49c5a service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:37:52.418314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1219/2436] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:37:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:37:55.966396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd04e2-a6a4-4a23-9010-0f40950d247f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:37:55.967412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd04e2-a6a4-4a23-9010-0f40950d247f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:37:55.967843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd04e2-a6a4-4a23-9010-0f40950d247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:37:56.016021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-26bd04e2-a6a4-4a23-9010-0f40950d247f None None] MFA Rules not processed for user `886527dcd4364610a2eba1eb2df3f3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:37:56.018690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-26bd04e2-a6a4-4a23-9010-0f40950d247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:37:56.041756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1218/2437] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:37:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:02.411706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=32 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:05.991853 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=33 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:08.372320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a461a-c6a7-4d67-bf1e-736af8782136 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:08.372868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a461a-c6a7-4d67-bf1e-736af8782136 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:08.373113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a461a-c6a7-4d67-bf1e-736af8782136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:08.399083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-599a461a-c6a7-4d67-bf1e-736af8782136 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:08.400333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-599a461a-c6a7-4d67-bf1e-736af8782136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:08.418801 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1220/2438] 10.222.0.69 () {58 vars in 967 bytes} [Thu Aug 4 02:38:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:08.434619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd04e2-a6a4-4a23-9010-0f40950d247f None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:08.447669 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd04e2-a6a4-4a23-9010-0f40950d247f None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:08.453551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474a65-3107-4b25-856f-b8dbaf0cd2c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:08.454292 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474a65-3107-4b25-856f-b8dbaf0cd2c7 service swift] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:08.454850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474a65-3107-4b25-856f-b8dbaf0cd2c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:08.455090 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474a65-3107-4b25-856f-b8dbaf0cd2c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:08.472084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474a65-3107-4b25-856f-b8dbaf0cd2c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:08.474553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474a65-3107-4b25-856f-b8dbaf0cd2c7 service swift] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:08.484828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1219/2439] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:38:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:38:10.545060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a461a-c6a7-4d67-bf1e-736af8782136 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:10.547206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-599a461a-c6a7-4d67-bf1e-736af8782136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:10.643320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a461a-c6a7-4d67-bf1e-736af8782136 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:10.647990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:10.648636 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:10.648921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:10.649203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] PATH_INFO: `/v3/users/1553810df7084cfa9451f2582043a423` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:10.650426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1553810df7084cfa9451f2582043a423)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:10.652344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:10.702794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1553810df7084cfa9451f2582043a423'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:10.711094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1553810df7084cfa9451f2582043a423'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:10.718059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1553810df7084cfa9451f2582043a423'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:10.718698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1553810df7084cfa9451f2582043a423'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:10.719295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c9a9c429-407f-41e4-b552-172c31dce292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1553810df7084cfa9451f2582043a423'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:10.742107 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1221/2440] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:10 2022] DELETE /identity/v3/users/1553810df7084cfa9451f2582043a423 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:11.033215 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474a65-3107-4b25-856f-b8dbaf0cd2c7 service swift] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:11.044696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474a65-3107-4b25-856f-b8dbaf0cd2c7 service swift] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:11.150754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:11.151414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:11.151691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:11.152243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] PATH_INFO: `/v3/projects/78f6f76353b847c995eca71c9d6418f0` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:11.153437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f6f76353b847c995eca71c9d6418f0)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:11.155416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:11.230668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f6f76353b847c995eca71c9d6418f0', 'request_id': 'req-c428efa5-8b22-4638-ab58-a64adbee723b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:11.254344 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f6f76353b847c995eca71c9d6418f0', 'request_id': 'req-c428efa5-8b22-4638-ab58-a64adbee723b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:11.261587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f6f76353b847c995eca71c9d6418f0', 'request_id': 'req-c428efa5-8b22-4638-ab58-a64adbee723b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:11.306909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] The token cache is being invalidate because project 78f6f76353b847c995eca71c9d6418f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:11.307230 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:11.307894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-c428efa5-8b22-4638-ab58-a64adbee723b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:11.323143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1220/2441] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:11 2022] DELETE /identity/v3/projects/78f6f76353b847c995eca71c9d6418f0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:11.581663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01390ea8-1adb-4a2f-9e7c-78890f6559a9 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:11.582151 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01390ea8-1adb-4a2f-9e7c-78890f6559a9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:11.582335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01390ea8-1adb-4a2f-9e7c-78890f6559a9 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:11.584643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1222/2442] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:38:11.600940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ccec2-70e9-4613-bc0e-c8ade140a1ff None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:11.601219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ccec2-70e9-4613-bc0e-c8ade140a1ff None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:11.604483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ccec2-70e9-4613-bc0e-c8ade140a1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:11.651446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e28ccec2-70e9-4613-bc0e-c8ade140a1ff None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:11.654206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e28ccec2-70e9-4613-bc0e-c8ade140a1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:11.778979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1221/2443] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:38:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:20.739433 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:21.365198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01390ea8-1adb-4a2f-9e7c-78890f6559a9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:21.368176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-01390ea8-1adb-4a2f-9e7c-78890f6559a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:21.445906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01390ea8-1adb-4a2f-9e7c-78890f6559a9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:21.449456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9c883-89c7-49b3-ae0d-c94b08633620 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2ef9088a9941ddb4b163f282a1f7d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:21.450061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c883-89c7-49b3-ae0d-c94b08633620 service glance] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:21.450340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c883-89c7-49b3-ae0d-c94b08633620 service glance] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:21.450610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c883-89c7-49b3-ae0d-c94b08633620 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:21.461154 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9c883-89c7-49b3-ae0d-c94b08633620 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:21.462631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9c883-89c7-49b3-ae0d-c94b08633620 service glance] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:21.473260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1223/2444] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:21.768565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:25.336294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd56f6-731a-4a60-bf70-2986acaf6784 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:25.336861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd56f6-731a-4a60-bf70-2986acaf6784 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:25.336861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd56f6-731a-4a60-bf70-2986acaf6784 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:25.338213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1222/2445] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:38:25.343089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4df3e6-b472-484b-aa5a-e487d4cb30df None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:25.343510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4df3e6-b472-484b-aa5a-e487d4cb30df None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:25.343662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4df3e6-b472-484b-aa5a-e487d4cb30df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:25.365867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bc4df3e6-b472-484b-aa5a-e487d4cb30df None None] MFA Rules not processed for user `d110c27fc9c045ea9a4eb49b4dafe221`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:25.367164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bc4df3e6-b472-484b-aa5a-e487d4cb30df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:25.420073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1224/2446] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:38:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:25.431621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd56f6-731a-4a60-bf70-2986acaf6784 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:25.433285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-68bd56f6-731a-4a60-bf70-2986acaf6784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:25.446239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd56f6-731a-4a60-bf70-2986acaf6784 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:25.449745 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac2eb3-1c2e-411f-8ac8-c2f5286e6939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:25.450344 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac2eb3-1c2e-411f-8ac8-c2f5286e6939 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:25.450617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac2eb3-1c2e-411f-8ac8-c2f5286e6939 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:25.450885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac2eb3-1c2e-411f-8ac8-c2f5286e6939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:25.458060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac2eb3-1c2e-411f-8ac8-c2f5286e6939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:25.460009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac2eb3-1c2e-411f-8ac8-c2f5286e6939 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:25.468504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1223/2447] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:25.587040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517858a9-4ec4-443f-a6b8-6d922aff674d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:25.587330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517858a9-4ec4-443f-a6b8-6d922aff674d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:25.587616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517858a9-4ec4-443f-a6b8-6d922aff674d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:25.589029 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1225/2448] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:38:25.594319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a24131-7741-4b80-9e57-f0b40b0a58ab None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:25.594612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a24131-7741-4b80-9e57-f0b40b0a58ab None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:25.594893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a24131-7741-4b80-9e57-f0b40b0a58ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:25.614957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-79a24131-7741-4b80-9e57-f0b40b0a58ab None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:25.616161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-79a24131-7741-4b80-9e57-f0b40b0a58ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:25.625440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1224/2449] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:38:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:25.635758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517858a9-4ec4-443f-a6b8-6d922aff674d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:25.647095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517858a9-4ec4-443f-a6b8-6d922aff674d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:25.650689 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36ddc-6171-47f0-b06b-4c8d8b3d1d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:25.651330 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36ddc-6171-47f0-b06b-4c8d8b3d1d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:25.651615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36ddc-6171-47f0-b06b-4c8d8b3d1d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:25.651894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36ddc-6171-47f0-b06b-4c8d8b3d1d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:25.663406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc36ddc-6171-47f0-b06b-4c8d8b3d1d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:25.665036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc36ddc-6171-47f0-b06b-4c8d8b3d1d8c service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:25.679023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1226/2450] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:28.056634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a118-0402-4087-a042-debc37089298 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:28.057096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a118-0402-4087-a042-debc37089298 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:28.057217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394a118-0402-4087-a042-debc37089298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:28.076096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e394a118-0402-4087-a042-debc37089298 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:28.077291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e394a118-0402-4087-a042-debc37089298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:28.133076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1225/2451] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:38:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:28.154329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36ddc-6171-47f0-b06b-4c8d8b3d1d8c service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:28.155699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2fc36ddc-6171-47f0-b06b-4c8d8b3d1d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:28.226608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36ddc-6171-47f0-b06b-4c8d8b3d1d8c service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:28.231516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e931e38-9e9f-4a3b-8b00-777fd971b481 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:28.232127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e931e38-9e9f-4a3b-8b00-777fd971b481 service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:28.232409 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e931e38-9e9f-4a3b-8b00-777fd971b481 service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:28.232680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e931e38-9e9f-4a3b-8b00-777fd971b481 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:28.241299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e931e38-9e9f-4a3b-8b00-777fd971b481 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:28.242853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e931e38-9e9f-4a3b-8b00-777fd971b481 service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:28.250778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1227/2452] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:38:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:38:34.785953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394a118-0402-4087-a042-debc37089298 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:34.787447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e394a118-0402-4087-a042-debc37089298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:34.879731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394a118-0402-4087-a042-debc37089298 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:34.893797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:34.894468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:34.894751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:34.895020 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] PATH_INFO: `/v3/users/fe33b0e819b94ddab9193a3379fd609f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:34.896227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe33b0e819b94ddab9193a3379fd609f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:34.898420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:34.975505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe33b0e819b94ddab9193a3379fd609f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:34.985451 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe33b0e819b94ddab9193a3379fd609f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe33b0e819b94ddab9193a3379fd609f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.007229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe33b0e819b94ddab9193a3379fd609f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.018058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe33b0e819b94ddab9193a3379fd609f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.024749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1226/2453] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:38:34 2022] DELETE /identity/v3/users/fe33b0e819b94ddab9193a3379fd609f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:35.029226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb052ab-7d0b-4e9a-b959-2d8da20c29b9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.029780 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb052ab-7d0b-4e9a-b959-2d8da20c29b9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.029882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb052ab-7d0b-4e9a-b959-2d8da20c29b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.061352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6bb052ab-7d0b-4e9a-b959-2d8da20c29b9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:35.061352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6bb052ab-7d0b-4e9a-b959-2d8da20c29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:35.088475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:35.134286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1228/2454] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:35.144346 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:35.145808 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:35.152939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:35.206209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6e05-772c-44c6-bed0-4e937a6d3c1e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:35.209975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be5f6-75e2-4346-b0a2-c99ca51b2cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:35.210591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be5f6-75e2-4346-b0a2-c99ca51b2cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.210869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be5f6-75e2-4346-b0a2-c99ca51b2cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.211674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be5f6-75e2-4346-b0a2-c99ca51b2cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.221715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be5f6-75e2-4346-b0a2-c99ca51b2cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:35.223315 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be5f6-75e2-4346-b0a2-c99ca51b2cd2 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:35.234102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1227/2455] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:35.562669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb052ab-7d0b-4e9a-b959-2d8da20c29b9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:35.564991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6bb052ab-7d0b-4e9a-b959-2d8da20c29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:35.584668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb052ab-7d0b-4e9a-b959-2d8da20c29b9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:35.590408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:35.591337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:35.591621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:35.591962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] PATH_INFO: `/v3/projects/22ad94576bd84563ba3d196aa6d441bb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:35.593362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ad94576bd84563ba3d196aa6d441bb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:35.598164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:35.660651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ad94576bd84563ba3d196aa6d441bb', 'request_id': 'req-bf3170a8-518d-4199-a178-d7bf2faedb18'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.671367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ad94576bd84563ba3d196aa6d441bb', 'request_id': 'req-bf3170a8-518d-4199-a178-d7bf2faedb18'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.677166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ad94576bd84563ba3d196aa6d441bb', 'request_id': 'req-bf3170a8-518d-4199-a178-d7bf2faedb18'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.689267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] The token cache is being invalidate because project 22ad94576bd84563ba3d196aa6d441bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:38:35.689586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.690232 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:38:35.691756 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1229/2456] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:38:35 2022] DELETE /identity/v3/projects/22ad94576bd84563ba3d196aa6d441bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:38:43.719720 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be822-e543-4d5f-8f8a-9c29fe01b182 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:43.720185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be822-e543-4d5f-8f8a-9c29fe01b182 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:43.720185 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690be822-e543-4d5f-8f8a-9c29fe01b182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:43.750084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-690be822-e543-4d5f-8f8a-9c29fe01b182 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:43.751320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-690be822-e543-4d5f-8f8a-9c29fe01b182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:43.830672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1228/2457] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:43.846483 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:43.848735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:43.935798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3170a8-518d-4199-a178-d7bf2faedb18 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:43.941713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284520a-b702-4f36-b6c7-d3090e93dc70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:43.942504 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284520a-b702-4f36-b6c7-d3090e93dc70 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:43.942789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284520a-b702-4f36-b6c7-d3090e93dc70 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:43.943112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284520a-b702-4f36-b6c7-d3090e93dc70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:43.954141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284520a-b702-4f36-b6c7-d3090e93dc70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:43.955978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284520a-b702-4f36-b6c7-d3090e93dc70 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:43.967422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1230/2458] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:46.698863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13297608-baa0-4119-ac92-66ab31fd2943 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:46.699376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13297608-baa0-4119-ac92-66ab31fd2943 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:46.699474 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13297608-baa0-4119-ac92-66ab31fd2943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:46.719278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-13297608-baa0-4119-ac92-66ab31fd2943 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:46.720530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-13297608-baa0-4119-ac92-66ab31fd2943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:46.728479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1229/2459] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:38:46.746988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284520a-b702-4f36-b6c7-d3090e93dc70 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:46.758823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284520a-b702-4f36-b6c7-d3090e93dc70 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:46.764226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fb177-eb37-490e-8a54-e3524b99d4aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:46.764826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fb177-eb37-490e-8a54-e3524b99d4aa service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:46.765108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fb177-eb37-490e-8a54-e3524b99d4aa service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:46.765418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fb177-eb37-490e-8a54-e3524b99d4aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:46.774158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fb177-eb37-490e-8a54-e3524b99d4aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:46.775729 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fb177-eb37-490e-8a54-e3524b99d4aa service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:46.785087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1231/2460] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:48.284675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50173734-a968-4378-8307-3432ba435536 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:48.285161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50173734-a968-4378-8307-3432ba435536 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:48.285282 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50173734-a968-4378-8307-3432ba435536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:48.303804 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-50173734-a968-4378-8307-3432ba435536 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:48.304991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-50173734-a968-4378-8307-3432ba435536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:48.358652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1230/2461] 10.222.0.69 () {58 vars in 967 bytes} [Thu Aug 4 02:38:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:48.371526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fb177-eb37-490e-8a54-e3524b99d4aa service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:48.372911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-355fb177-eb37-490e-8a54-e3524b99d4aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:48.401717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:48.443449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fb177-eb37-490e-8a54-e3524b99d4aa service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:48.448881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592518e5-3499-4ee2-af75-a98d80ef659f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:48.449526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592518e5-3499-4ee2-af75-a98d80ef659f service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:48.449802 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592518e5-3499-4ee2-af75-a98d80ef659f service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:48.450070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592518e5-3499-4ee2-af75-a98d80ef659f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:48.457955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592518e5-3499-4ee2-af75-a98d80ef659f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:48.459457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592518e5-3499-4ee2-af75-a98d80ef659f service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:48.467950 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1232/2462] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:38:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:38:52.004195 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec541ce-9942-4c41-afa7-71c641fd2251 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:52.004728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec541ce-9942-4c41-afa7-71c641fd2251 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:52.004728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec541ce-9942-4c41-afa7-71c641fd2251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:52.024622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4ec541ce-9942-4c41-afa7-71c641fd2251 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:52.025837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4ec541ce-9942-4c41-afa7-71c641fd2251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:52.033480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1231/2463] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:52.047894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592518e5-3499-4ee2-af75-a98d80ef659f service swift] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:52.049277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-592518e5-3499-4ee2-af75-a98d80ef659f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:52.064674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592518e5-3499-4ee2-af75-a98d80ef659f service swift] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:52.070532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d537c-8ee1-4ee1-9a5e-3e5fddb40180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:52.071121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d537c-8ee1-4ee1-9a5e-3e5fddb40180 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:52.071398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d537c-8ee1-4ee1-9a5e-3e5fddb40180 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:52.071665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d537c-8ee1-4ee1-9a5e-3e5fddb40180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:52.079698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d537c-8ee1-4ee1-9a5e-3e5fddb40180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:52.081248 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d537c-8ee1-4ee1-9a5e-3e5fddb40180 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:52.091160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1233/2464] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:54.151266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec541ce-9942-4c41-afa7-71c641fd2251 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:54.152650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4ec541ce-9942-4c41-afa7-71c641fd2251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:54.194333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:38:54.208972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec541ce-9942-4c41-afa7-71c641fd2251 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:54.213146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590adcba-3d2e-4d19-9819-ae752db395f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:54.213793 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590adcba-3d2e-4d19-9819-ae752db395f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:54.214069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590adcba-3d2e-4d19-9819-ae752db395f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:54.214339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590adcba-3d2e-4d19-9819-ae752db395f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:54.216092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-590adcba-3d2e-4d19-9819-ae752db395f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:54.282774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590adcba-3d2e-4d19-9819-ae752db395f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:54.284211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590adcba-3d2e-4d19-9819-ae752db395f0 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:54.294469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1232/2465] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:56.129144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb8bab-1b43-48a0-8e20-73d4d4d043e6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:56.129723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb8bab-1b43-48a0-8e20-73d4d4d043e6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:56.129816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb8bab-1b43-48a0-8e20-73d4d4d043e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:56.152339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4fdb8bab-1b43-48a0-8e20-73d4d4d043e6 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:56.153917 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4fdb8bab-1b43-48a0-8e20-73d4d4d043e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:56.165850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1234/2466] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:56.180416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590adcba-3d2e-4d19-9819-ae752db395f0 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:56.194203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590adcba-3d2e-4d19-9819-ae752db395f0 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:56.200148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244d414-48a8-4632-bf40-d05daf046b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:56.200770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244d414-48a8-4632-bf40-d05daf046b24 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:56.201047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244d414-48a8-4632-bf40-d05daf046b24 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:56.201319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244d414-48a8-4632-bf40-d05daf046b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:56.210753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244d414-48a8-4632-bf40-d05daf046b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:56.212323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244d414-48a8-4632-bf40-d05daf046b24 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:56.222465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1233/2467] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:38:58.411935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb8bab-1b43-48a0-8e20-73d4d4d043e6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:58.413442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4fdb8bab-1b43-48a0-8e20-73d4d4d043e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:58.493358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb8bab-1b43-48a0-8e20-73d4d4d043e6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:58.498408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed8710-d97b-4e16-9f93-d330a19d6a29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:58.499021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed8710-d97b-4e16-9f93-d330a19d6a29 service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:58.499299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed8710-d97b-4e16-9f93-d330a19d6a29 service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:58.499572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed8710-d97b-4e16-9f93-d330a19d6a29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:58.501293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b7ed8710-d97b-4e16-9f93-d330a19d6a29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:58.513876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed8710-d97b-4e16-9f93-d330a19d6a29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:58.515472 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed8710-d97b-4e16-9f93-d330a19d6a29 service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:58.525490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1235/2468] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:38:59.431450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca2228-1b16-42f5-99dc-39557517e4db None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:59.431940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca2228-1b16-42f5-99dc-39557517e4db None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:59.432037 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca2228-1b16-42f5-99dc-39557517e4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:59.451496 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-0fca2228-1b16-42f5-99dc-39557517e4db None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:38:59.452674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0fca2228-1b16-42f5-99dc-39557517e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:38:59.460460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1234/2469] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:38:59.475927 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed8710-d97b-4e16-9f93-d330a19d6a29 service placement] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:38:59.488029 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed8710-d97b-4e16-9f93-d330a19d6a29 service placement] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:38:59.499258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef669b20-ec2d-48e4-a23d-7c0b49232bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:38:59.499895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef669b20-ec2d-48e4-a23d-7c0b49232bf2 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:38:59.500174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef669b20-ec2d-48e4-a23d-7c0b49232bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:38:59.500443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef669b20-ec2d-48e4-a23d-7c0b49232bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:38:59.509306 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef669b20-ec2d-48e4-a23d-7c0b49232bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:38:59.510899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef669b20-ec2d-48e4-a23d-7c0b49232bf2 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:38:59.520220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1236/2470] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:02.609928 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e787f19-c517-4422-b9eb-e3c216b96682 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:02.610498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e787f19-c517-4422-b9eb-e3c216b96682 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:02.610596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e787f19-c517-4422-b9eb-e3c216b96682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:02.631296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9e787f19-c517-4422-b9eb-e3c216b96682 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:02.632494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9e787f19-c517-4422-b9eb-e3c216b96682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:02.641025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1235/2471] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:39:02.660258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef669b20-ec2d-48e4-a23d-7c0b49232bf2 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:02.671340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef669b20-ec2d-48e4-a23d-7c0b49232bf2 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:02.676794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a77bb-16df-48e2-b224-9219d97e42e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:02.677415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a77bb-16df-48e2-b224-9219d97e42e7 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:02.677696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a77bb-16df-48e2-b224-9219d97e42e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:02.677963 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a77bb-16df-48e2-b224-9219d97e42e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:02.686229 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a77bb-16df-48e2-b224-9219d97e42e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:02.687794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a77bb-16df-48e2-b224-9219d97e42e7 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:02.698143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1237/2472] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:12.624803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=44 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:12.693074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=74 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:17.822605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb200-a1c6-4cbd-a49b-97acca0698e3 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:17.823060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb200-a1c6-4cbd-a49b-97acca0698e3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:17.823184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb200-a1c6-4cbd-a49b-97acca0698e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:17.841683 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-fe3fb200-a1c6-4cbd-a49b-97acca0698e3 None None] MFA Rules not processed for user `c026d9361da04b1782a78dac8f2c24e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:17.842811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fe3fb200-a1c6-4cbd-a49b-97acca0698e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:17.896502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1236/2473] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:39:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:26.471538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f6be-7675-44d2-816e-ab81c55ef897 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:26.472027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f6be-7675-44d2-816e-ab81c55ef897 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:26.472121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f6be-7675-44d2-816e-ab81c55ef897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:26.491137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d8e5f6be-7675-44d2-816e-ab81c55ef897 None None] MFA Rules not processed for user `7be58892888f468d9caaeec9f02c5fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:26.492947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d8e5f6be-7675-44d2-816e-ab81c55ef897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:26.546139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1238/2474] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:39:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:27.890105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=25 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:31.884843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701d31-a1d3-4d0a-8a33-566e5c8df66e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:31.885532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701d31-a1d3-4d0a-8a33-566e5c8df66e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:31.885644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04701d31-a1d3-4d0a-8a33-566e5c8df66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:31.909699 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-04701d31-a1d3-4d0a-8a33-566e5c8df66e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:31.910953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-04701d31-a1d3-4d0a-8a33-566e5c8df66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:31.920018 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1237/2475] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:31.934390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f6be-7675-44d2-816e-ab81c55ef897 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:31.947104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f6be-7675-44d2-816e-ab81c55ef897 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:31.952537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6ccb6-4e61-4330-9ebf-61f5348e797d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:31.953143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6ccb6-4e61-4330-9ebf-61f5348e797d service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:31.953534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6ccb6-4e61-4330-9ebf-61f5348e797d service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:31.953805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6ccb6-4e61-4330-9ebf-61f5348e797d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:31.962659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6ccb6-4e61-4330-9ebf-61f5348e797d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:31.964278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6ccb6-4e61-4330-9ebf-61f5348e797d service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:31.974060 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1239/2476] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:35.117176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfb022-7a47-49eb-88e8-d6e64c60f41d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:35.118261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfb022-7a47-49eb-88e8-d6e64c60f41d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:35.118261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfb022-7a47-49eb-88e8-d6e64c60f41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:35.139581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e0bfb022-7a47-49eb-88e8-d6e64c60f41d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:35.142043 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e0bfb022-7a47-49eb-88e8-d6e64c60f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:35.149088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1238/2477] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:35.163034 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6ccb6-4e61-4330-9ebf-61f5348e797d service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:35.176056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6ccb6-4e61-4330-9ebf-61f5348e797d service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:35.182462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e98a5d-c1be-4cd2-8d52-3b9ff57452cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:35.183263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e98a5d-c1be-4cd2-8d52-3b9ff57452cd service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:35.183713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e98a5d-c1be-4cd2-8d52-3b9ff57452cd service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:35.184147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e98a5d-c1be-4cd2-8d52-3b9ff57452cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:35.193497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e98a5d-c1be-4cd2-8d52-3b9ff57452cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:35.195365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e98a5d-c1be-4cd2-8d52-3b9ff57452cd service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:35.207872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1240/2478] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:40.298434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d110-077c-4fc0-9aa0-5cfb422607bc None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:40.298929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d110-077c-4fc0-9aa0-5cfb422607bc None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:40.299025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d110-077c-4fc0-9aa0-5cfb422607bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:40.330077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-0a88d110-077c-4fc0-9aa0-5cfb422607bc None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:40.331299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0a88d110-077c-4fc0-9aa0-5cfb422607bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:40.341671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1239/2479] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:40.356933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e98a5d-c1be-4cd2-8d52-3b9ff57452cd service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:40.371839 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e98a5d-c1be-4cd2-8d52-3b9ff57452cd service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:40.377945 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd544b-a03e-4700-b75a-6e614055020d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:40.378861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd544b-a03e-4700-b75a-6e614055020d service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:40.379137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd544b-a03e-4700-b75a-6e614055020d service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:40.379410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd544b-a03e-4700-b75a-6e614055020d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:40.393155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd544b-a03e-4700-b75a-6e614055020d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:40.395193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd544b-a03e-4700-b75a-6e614055020d service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:40.417964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1241/2480] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:43.475783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1174e-61a2-4190-bb79-33a6ce00bdfe None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:43.476224 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1174e-61a2-4190-bb79-33a6ce00bdfe None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:43.477070 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1174e-61a2-4190-bb79-33a6ce00bdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:43.498369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416cce8-ebfe-43dc-8764-36a3489bc630 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:43.498895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416cce8-ebfe-43dc-8764-36a3489bc630 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:43.499098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416cce8-ebfe-43dc-8764-36a3489bc630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:43.503522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f6d1174e-61a2-4190-bb79-33a6ce00bdfe None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:43.504782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f6d1174e-61a2-4190-bb79-33a6ce00bdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:43.512740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1240/2481] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:39:43.518520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7416cce8-ebfe-43dc-8764-36a3489bc630 None None] MFA Rules not processed for user `a1631559d5194f1fa449a16f93546349`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:43.519696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7416cce8-ebfe-43dc-8764-36a3489bc630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:43.530544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1174e-61a2-4190-bb79-33a6ce00bdfe None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:43.543347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1174e-61a2-4190-bb79-33a6ce00bdfe None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:43.548780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b172232-5804-405d-ad5e-a76db3b4bb49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:43.549400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b172232-5804-405d-ad5e-a76db3b4bb49 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:43.549675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b172232-5804-405d-ad5e-a76db3b4bb49 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:43.549945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b172232-5804-405d-ad5e-a76db3b4bb49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:43.561432 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b172232-5804-405d-ad5e-a76db3b4bb49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:43.563190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b172232-5804-405d-ad5e-a76db3b4bb49 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:43.573463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1241/2482] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:43.585122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1242/2483] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:39:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:39:46.672042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293c7af-7ab0-47ad-aec2-640867d4643d None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:46.672970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293c7af-7ab0-47ad-aec2-640867d4643d None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:46.673812 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293c7af-7ab0-47ad-aec2-640867d4643d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:46.700582 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4293c7af-7ab0-47ad-aec2-640867d4643d None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:39:46.701888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4293c7af-7ab0-47ad-aec2-640867d4643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:39:46.712794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1242/2484] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Aug 4 02:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:39:46.733249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416cce8-ebfe-43dc-8764-36a3489bc630 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:39:46.747787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416cce8-ebfe-43dc-8764-36a3489bc630 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:39:46.754193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761fd06-8b39-4740-8fa9-2d1bd52a94a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:39:46.754853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761fd06-8b39-4740-8fa9-2d1bd52a94a3 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:39:46.755135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761fd06-8b39-4740-8fa9-2d1bd52a94a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:39:46.755458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761fd06-8b39-4740-8fa9-2d1bd52a94a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:39:46.766315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761fd06-8b39-4740-8fa9-2d1bd52a94a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:39:46.767914 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761fd06-8b39-4740-8fa9-2d1bd52a94a3 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:39:46.779181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1243/2485] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:39:56.693583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=21 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:39:56.775070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=74 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:15.878067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb211279-3fb3-4e97-8d96-2c737acb9292 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:15.878603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb211279-3fb3-4e97-8d96-2c737acb9292 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:15.878757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb211279-3fb3-4e97-8d96-2c737acb9292 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:15.880206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1243/2486] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:40:15.907440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f3072-4a78-4d20-b68f-598878abcfe6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:15.907939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f3072-4a78-4d20-b68f-598878abcfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:15.908046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f3072-4a78-4d20-b68f-598878abcfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:15.932168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4f7f3072-4a78-4d20-b68f-598878abcfe6 None None] MFA Rules not processed for user `234cbff2a729458a8dad108baaba6c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:15.934486 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4f7f3072-4a78-4d20-b68f-598878abcfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:15.944456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1244/2487] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:40:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:15.945732 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb211279-3fb3-4e97-8d96-2c737acb9292 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:15.947398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fb211279-3fb3-4e97-8d96-2c737acb9292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:15.963193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb211279-3fb3-4e97-8d96-2c737acb9292 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:15.963637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f3072-4a78-4d20-b68f-598878abcfe6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:15.965044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4f7f3072-4a78-4d20-b68f-598878abcfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:15.967751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:15.968415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:15.968694 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:15.968964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] PATH_INFO: `/v3/users/c026d9361da04b1782a78dac8f2c24e8` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:15.970184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c026d9361da04b1782a78dac8f2c24e8)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:15.972077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:15.978150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f3072-4a78-4d20-b68f-598878abcfe6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:15.983172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7649-7228-4cbe-b76b-1d06998fe58f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:15.983779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7649-7228-4cbe-b76b-1d06998fe58f service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:15.984061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7649-7228-4cbe-b76b-1d06998fe58f service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:15.984333 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7649-7228-4cbe-b76b-1d06998fe58f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:15.993223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f7649-7228-4cbe-b76b-1d06998fe58f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:15.994846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f7649-7228-4cbe-b76b-1d06998fe58f service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:16.009302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1245/2488] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:16.026293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c026d9361da04b1782a78dac8f2c24e8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.033898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c026d9361da04b1782a78dac8f2c24e8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.040890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c026d9361da04b1782a78dac8f2c24e8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.041571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c026d9361da04b1782a78dac8f2c24e8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.053317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f0fd44da-af09-46b3-bd8d-748241722b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c026d9361da04b1782a78dac8f2c24e8'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.059765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1244/2489] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:40:15 2022] DELETE /identity/v3/users/c026d9361da04b1782a78dac8f2c24e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:40:16.234600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7649-7228-4cbe-b76b-1d06998fe58f service placement] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:16.249888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7649-7228-4cbe-b76b-1d06998fe58f service placement] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:16.306955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:16.307496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:16.307773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:16.308040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] PATH_INFO: `/v3/projects/254a723e5f7b46bdbcea5c8e9a50734c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:16.309154 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=254a723e5f7b46bdbcea5c8e9a50734c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:16.311071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:16.355234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254a723e5f7b46bdbcea5c8e9a50734c', 'request_id': 'req-6862a226-295b-499f-bf1a-0850b7e0bb4f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.362013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254a723e5f7b46bdbcea5c8e9a50734c', 'request_id': 'req-6862a226-295b-499f-bf1a-0850b7e0bb4f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.368748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254a723e5f7b46bdbcea5c8e9a50734c', 'request_id': 'req-6862a226-295b-499f-bf1a-0850b7e0bb4f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.380521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] The token cache is being invalidate because project 254a723e5f7b46bdbcea5c8e9a50734c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:40:16.380806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.381460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:16.383013 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1246/2490] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:40:16 2022] DELETE /identity/v3/projects/254a723e5f7b46bdbcea5c8e9a50734c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:26.056138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:26.377481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:31.157990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced843b-3160-4367-901f-14ba1e5a39b6 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:31.158490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced843b-3160-4367-901f-14ba1e5a39b6 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:31.158596 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced843b-3160-4367-901f-14ba1e5a39b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:31.177460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3ced843b-3160-4367-901f-14ba1e5a39b6 None None] MFA Rules not processed for user `bb8f655ed67d46a5b4211a851f8da02d`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:31.178641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3ced843b-3160-4367-901f-14ba1e5a39b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:31.232938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1245/2491] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:40:37.629201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:37.630678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:37.698678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a226-295b-499f-bf1a-0850b7e0bb4f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:37.703199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:37.703821 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:37.704098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:37.704370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] PATH_INFO: `/v3/users/7be58892888f468d9caaeec9f02c5fa2` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:37.705567 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be58892888f468d9caaeec9f02c5fa2)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:37.707491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:37.756385 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be58892888f468d9caaeec9f02c5fa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:37.764634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be58892888f468d9caaeec9f02c5fa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:37.772495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be58892888f468d9caaeec9f02c5fa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:37.773173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be58892888f468d9caaeec9f02c5fa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:37.774428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1e905821-5965-4806-952e-c4111509d381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be58892888f468d9caaeec9f02c5fa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:37.795307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1247/2492] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:40:37 2022] DELETE /identity/v3/users/7be58892888f468d9caaeec9f02c5fa2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:37.979252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced843b-3160-4367-901f-14ba1e5a39b6 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:37.991510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced843b-3160-4367-901f-14ba1e5a39b6 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:38.057574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:38.058625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.058625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.058987 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] PATH_INFO: `/v3/projects/2dfffc86a08d462c8e471a909f56b3c3` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.060313 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dfffc86a08d462c8e471a909f56b3c3)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:38.062337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:38.110936 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dfffc86a08d462c8e471a909f56b3c3', 'request_id': 'req-ecde6722-f31d-47d0-9d82-7649ab973a7d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:38.120389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dfffc86a08d462c8e471a909f56b3c3', 'request_id': 'req-ecde6722-f31d-47d0-9d82-7649ab973a7d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:38.126631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dfffc86a08d462c8e471a909f56b3c3', 'request_id': 'req-ecde6722-f31d-47d0-9d82-7649ab973a7d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:38.138435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] The token cache is being invalidate because project 2dfffc86a08d462c8e471a909f56b3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:40:38.138751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:38.139393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ecde6722-f31d-47d0-9d82-7649ab973a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:38.141217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1246/2493] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:40:37 2022] DELETE /identity/v3/projects/2dfffc86a08d462c8e471a909f56b3c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:38.146036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667e7f5-a811-4277-b700-c99b66de6714 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.146322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667e7f5-a811-4277-b700-c99b66de6714 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.146596 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667e7f5-a811-4277-b700-c99b66de6714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.165793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e667e7f5-a811-4277-b700-c99b66de6714 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:38.166971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e667e7f5-a811-4277-b700-c99b66de6714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:38.224077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1248/2494] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:38.232001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dd02d-f762-4dd1-93da-a4fccd1f7e2c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.232304 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dd02d-f762-4dd1-93da-a4fccd1f7e2c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.232583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369dd02d-f762-4dd1-93da-a4fccd1f7e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.252866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-369dd02d-f762-4dd1-93da-a4fccd1f7e2c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:38.254109 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-369dd02d-f762-4dd1-93da-a4fccd1f7e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:38.262587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1247/2495] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:40:38.266773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667e7f5-a811-4277-b700-c99b66de6714 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:38.276443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667e7f5-a811-4277-b700-c99b66de6714 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:38.280843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ebe72-89c2-4dbf-8277-477f45760191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:38.281493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ebe72-89c2-4dbf-8277-477f45760191 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.281754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ebe72-89c2-4dbf-8277-477f45760191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.282028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ebe72-89c2-4dbf-8277-477f45760191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.282705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ebe72-89c2-4dbf-8277-477f45760191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:40:38.283021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ebe72-89c2-4dbf-8277-477f45760191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:38.284587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ebe72-89c2-4dbf-8277-477f45760191 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:38.295962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1249/2496] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:40:38.300364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369dd02d-f762-4dd1-93da-a4fccd1f7e2c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:38.310176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369dd02d-f762-4dd1-93da-a4fccd1f7e2c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:38.314776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741151e1-cd48-4812-ab2f-306c9e7468c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:38.315373 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741151e1-cd48-4812-ab2f-306c9e7468c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.315649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741151e1-cd48-4812-ab2f-306c9e7468c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.315919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741151e1-cd48-4812-ab2f-306c9e7468c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.316577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741151e1-cd48-4812-ab2f-306c9e7468c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:38.319167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741151e1-cd48-4812-ab2f-306c9e7468c7 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:38.348462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1248/2497] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:40:38 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:38.352725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ebe72-89c2-4dbf-8277-477f45760191 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:38.362800 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ebe72-89c2-4dbf-8277-477f45760191 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:38.366439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:38.428064 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40fc9d-dba6-4812-b857-15a7493f6418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:38.428679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40fc9d-dba6-4812-b857-15a7493f6418 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.429079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40fc9d-dba6-4812-b857-15a7493f6418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.429383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40fc9d-dba6-4812-b857-15a7493f6418 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.430644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40fc9d-dba6-4812-b857-15a7493f6418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:38.432727 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40fc9d-dba6-4812-b857-15a7493f6418 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:38.457869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1250/2498] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:40:38 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:38.462097 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741151e1-cd48-4812-ab2f-306c9e7468c7 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:38.473240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741151e1-cd48-4812-ab2f-306c9e7468c7 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:38.478421 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee1fb9-52de-4662-9415-0f735d947e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:38.479033 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee1fb9-52de-4662-9415-0f735d947e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.479306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee1fb9-52de-4662-9415-0f735d947e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.479573 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee1fb9-52de-4662-9415-0f735d947e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.480281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee1fb9-52de-4662-9415-0f735d947e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:38.481890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee1fb9-52de-4662-9415-0f735d947e1c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:38.483273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:38.495946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1249/2499] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:38.499455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40fc9d-dba6-4812-b857-15a7493f6418 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:38.509946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40fc9d-dba6-4812-b857-15a7493f6418 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:38.514719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c35881-ad54-4428-a758-0f3694ac3f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:38.515338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c35881-ad54-4428-a758-0f3694ac3f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.515613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c35881-ad54-4428-a758-0f3694ac3f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.515889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c35881-ad54-4428-a758-0f3694ac3f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.516581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c35881-ad54-4428-a758-0f3694ac3f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:38.518231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c35881-ad54-4428-a758-0f3694ac3f77 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:38.529568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1251/2500] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:38.533902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee1fb9-52de-4662-9415-0f735d947e1c admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:38.544672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee1fb9-52de-4662-9415-0f735d947e1c admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:38.549479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85defdb0-6463-4813-9260-63804e799434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:38.550035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85defdb0-6463-4813-9260-63804e799434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.550384 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85defdb0-6463-4813-9260-63804e799434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.550669 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85defdb0-6463-4813-9260-63804e799434 admin admin] PATH_INFO: `/v3/projects/04cd1b6c65e54e6faa3124fbe0095183/users/d21a8982ca9b4999ba40e6f02f85d652/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.566770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85defdb0-6463-4813-9260-63804e799434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04cd1b6c65e54e6faa3124fbe0095183, user_id=d21a8982ca9b4999ba40e6f02f85d652, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:38.569377 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85defdb0-6463-4813-9260-63804e799434 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:38.583381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1250/2501] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:38 2022] PUT /identity/v3/projects/04cd1b6c65e54e6faa3124fbe0095183/users/d21a8982ca9b4999ba40e6f02f85d652/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:40:38.593215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df18287-4555-4400-b415-0df1324812fb None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.593547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df18287-4555-4400-b415-0df1324812fb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.593809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df18287-4555-4400-b415-0df1324812fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.623925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4df18287-4555-4400-b415-0df1324812fb None None] MFA Rules not processed for user `d21a8982ca9b4999ba40e6f02f85d652`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:38.625441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4df18287-4555-4400-b415-0df1324812fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:38.691704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1252/2502] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:38.702747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85defdb0-6463-4813-9260-63804e799434 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:38.704416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-85defdb0-6463-4813-9260-63804e799434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:38.760908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85defdb0-6463-4813-9260-63804e799434 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:38.764569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e8b9-575e-42c8-868e-6aaf0bc407b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:38.765171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e8b9-575e-42c8-868e-6aaf0bc407b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:38.765488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e8b9-575e-42c8-868e-6aaf0bc407b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:38.765766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e8b9-575e-42c8-868e-6aaf0bc407b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:38.774648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636e8b9-575e-42c8-868e-6aaf0bc407b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:38.776052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636e8b9-575e-42c8-868e-6aaf0bc407b1 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:38.784858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1251/2503] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:47.176560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df18287-4555-4400-b415-0df1324812fb None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:47.238827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df18287-4555-4400-b415-0df1324812fb None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:47.243256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:47.243879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:47.244155 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:47.244425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] PATH_INFO: `/v3/users/d21a8982ca9b4999ba40e6f02f85d652` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:47.245611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21a8982ca9b4999ba40e6f02f85d652)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:47.247547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:47.263369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:47.293614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21a8982ca9b4999ba40e6f02f85d652'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.300410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21a8982ca9b4999ba40e6f02f85d652'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.307175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21a8982ca9b4999ba40e6f02f85d652'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.307785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21a8982ca9b4999ba40e6f02f85d652'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.308375 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21a8982ca9b4999ba40e6f02f85d652'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.325022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1253/2504] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:40:47 2022] DELETE /identity/v3/users/d21a8982ca9b4999ba40e6f02f85d652 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:47.329520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3713a-e97e-4590-8e1c-6481406ab3d9 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:47.330000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3713a-e97e-4590-8e1c-6481406ab3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:47.330191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3713a-e97e-4590-8e1c-6481406ab3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:47.349196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-24d3713a-e97e-4590-8e1c-6481406ab3d9 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:47.350408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-24d3713a-e97e-4590-8e1c-6481406ab3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:47.409677 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1252/2505] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:40:47.419253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:47.420650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:47.477952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e791c2-b76f-4bbd-b17d-1a70b55acb4f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:47.481534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e3166-8a9b-4c56-b165-6a232352cabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:47.482145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3166-8a9b-4c56-b165-6a232352cabb service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:47.482428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3166-8a9b-4c56-b165-6a232352cabb service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:47.482703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3166-8a9b-4c56-b165-6a232352cabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:47.491750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e3166-8a9b-4c56-b165-6a232352cabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:47.493173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e3166-8a9b-4c56-b165-6a232352cabb service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:47.502909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1254/2506] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:47.772485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3713a-e97e-4590-8e1c-6481406ab3d9 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:47.774055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-24d3713a-e97e-4590-8e1c-6481406ab3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:47.786234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3713a-e97e-4590-8e1c-6481406ab3d9 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:47.790943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:47.791581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:47.791860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:47.792134 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] PATH_INFO: `/v3/projects/04cd1b6c65e54e6faa3124fbe0095183` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:47.793300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04cd1b6c65e54e6faa3124fbe0095183)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:47.795218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:47.844498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04cd1b6c65e54e6faa3124fbe0095183', 'request_id': 'req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.851831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04cd1b6c65e54e6faa3124fbe0095183', 'request_id': 'req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.857408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04cd1b6c65e54e6faa3124fbe0095183', 'request_id': 'req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.864208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:47.869091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] The token cache is being invalidate because project 04cd1b6c65e54e6faa3124fbe0095183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:40:47.869408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.870141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a8693a3c-f7c7-4b74-96e1-e9a5fd436d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:47.872042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1253/2507] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:40:47 2022] DELETE /identity/v3/projects/04cd1b6c65e54e6faa3124fbe0095183 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:47.877199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b3d9-5f17-47da-b4c9-ef08994abc3a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:47.877511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b3d9-5f17-47da-b4c9-ef08994abc3a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:47.877788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b3d9-5f17-47da-b4c9-ef08994abc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:47.897234 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-83d2b3d9-5f17-47da-b4c9-ef08994abc3a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:47.898455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-83d2b3d9-5f17-47da-b4c9-ef08994abc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:47.959569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1255/2508] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:47.968594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbecff-09b1-42ba-bef4-ccfea3b2a958 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:47.968878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbecff-09b1-42ba-bef4-ccfea3b2a958 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:47.969175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbecff-09b1-42ba-bef4-ccfea3b2a958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:47.988257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4abbecff-09b1-42ba-bef4-ccfea3b2a958 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:47.989475 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4abbecff-09b1-42ba-bef4-ccfea3b2a958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:47.998089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1254/2509] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:48.002416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2b3d9-5f17-47da-b4c9-ef08994abc3a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.012605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2b3d9-5f17-47da-b4c9-ef08994abc3a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.017071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.017899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.018178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.018474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.019158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:40:48.019456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.021061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.033056 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1256/2510] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:40:48.037580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbecff-09b1-42ba-bef4-ccfea3b2a958 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.041872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.043706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:48.048298 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbecff-09b1-42ba-bef4-ccfea3b2a958 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.053672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8a1c4-5d7c-46f8-ba3c-07a81352701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.054300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a1c4-5d7c-46f8-ba3c-07a81352701d admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.054581 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a1c4-5d7c-46f8-ba3c-07a81352701d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.054858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a1c4-5d7c-46f8-ba3c-07a81352701d admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.056342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8a1c4-5d7c-46f8-ba3c-07a81352701d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.058265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8a1c4-5d7c-46f8-ba3c-07a81352701d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.073173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:48.087943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1255/2511] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:40:48 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:48.091993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8a1c4-5d7c-46f8-ba3c-07a81352701d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.109125 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce668b7-cd2a-4b9d-bab5-3e05e603dfd8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.155897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8a1c4-5d7c-46f8-ba3c-07a81352701d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.158039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478372f-df38-4884-8e8a-81c8ac07d869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.158643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478372f-df38-4884-8e8a-81c8ac07d869 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.158920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478372f-df38-4884-8e8a-81c8ac07d869 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.159189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478372f-df38-4884-8e8a-81c8ac07d869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.160766 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f13b02-ac74-48e7-aa03-c8ac8a125a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.160965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b478372f-df38-4884-8e8a-81c8ac07d869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:48.161406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f13b02-ac74-48e7-aa03-c8ac8a125a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.161690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f13b02-ac74-48e7-aa03-c8ac8a125a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.161967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f13b02-ac74-48e7-aa03-c8ac8a125a11 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.162628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f13b02-ac74-48e7-aa03-c8ac8a125a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.165049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f13b02-ac74-48e7-aa03-c8ac8a125a11 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.185974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1256/2512] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:40:48 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:40:48.190081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f13b02-ac74-48e7-aa03-c8ac8a125a11 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.199638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f13b02-ac74-48e7-aa03-c8ac8a125a11 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.204422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31600e-ded2-4cc8-8a04-ddcbc1557b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.205085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31600e-ded2-4cc8-8a04-ddcbc1557b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.205397 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31600e-ded2-4cc8-8a04-ddcbc1557b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.205674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31600e-ded2-4cc8-8a04-ddcbc1557b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.206360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31600e-ded2-4cc8-8a04-ddcbc1557b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.207932 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31600e-ded2-4cc8-8a04-ddcbc1557b09 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.218025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1257/2513] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:40:48.221661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31600e-ded2-4cc8-8a04-ddcbc1557b09 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.231470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31600e-ded2-4cc8-8a04-ddcbc1557b09 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.234762 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478372f-df38-4884-8e8a-81c8ac07d869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.236187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478372f-df38-4884-8e8a-81c8ac07d869 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.236355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274efbe-7db6-4f49-96ea-0cd5044bcd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.236943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274efbe-7db6-4f49-96ea-0cd5044bcd4f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.237221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274efbe-7db6-4f49-96ea-0cd5044bcd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.237550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274efbe-7db6-4f49-96ea-0cd5044bcd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.238221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274efbe-7db6-4f49-96ea-0cd5044bcd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.239785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274efbe-7db6-4f49-96ea-0cd5044bcd4f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.249270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1257/2514] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:40:48.254206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1258/2515] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:40:48.255208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478372f-df38-4884-8e8a-81c8ac07d869 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.265461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478372f-df38-4884-8e8a-81c8ac07d869 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.270029 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77bc6-ebb1-4382-bd80-915ad89be04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.270687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77bc6-ebb1-4382-bd80-915ad89be04e admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.270959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77bc6-ebb1-4382-bd80-915ad89be04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.271227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e77bc6-ebb1-4382-bd80-915ad89be04e admin admin] PATH_INFO: `/v3/projects/ad4c188dd0cc47c3a70f221ab2c07099/users/9edfa1ab9ea74c79bbb48ae9d8bb57e5/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.286237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e77bc6-ebb1-4382-bd80-915ad89be04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4c188dd0cc47c3a70f221ab2c07099, user_id=9edfa1ab9ea74c79bbb48ae9d8bb57e5, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.288899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e77bc6-ebb1-4382-bd80-915ad89be04e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.301973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1258/2516] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:48 2022] PUT /identity/v3/projects/ad4c188dd0cc47c3a70f221ab2c07099/users/9edfa1ab9ea74c79bbb48ae9d8bb57e5/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:40:48.312679 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09037ad-fff1-4cd1-8137-73c80cde8666 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.312963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09037ad-fff1-4cd1-8137-73c80cde8666 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.313233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09037ad-fff1-4cd1-8137-73c80cde8666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.342739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-a09037ad-fff1-4cd1-8137-73c80cde8666 None None] MFA Rules not processed for user `9edfa1ab9ea74c79bbb48ae9d8bb57e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:48.344062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a09037ad-fff1-4cd1-8137-73c80cde8666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:48.410051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1259/2517] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:48.415008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77bc6-ebb1-4382-bd80-915ad89be04e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.472089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:48.475535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e77bc6-ebb1-4382-bd80-915ad89be04e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.481649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51482372-5cb5-4f03-9ed1-c398799abc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.482244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51482372-5cb5-4f03-9ed1-c398799abc77 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.482521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51482372-5cb5-4f03-9ed1-c398799abc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.482792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51482372-5cb5-4f03-9ed1-c398799abc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.483439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51482372-5cb5-4f03-9ed1-c398799abc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.485383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51482372-5cb5-4f03-9ed1-c398799abc77 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.512703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1259/2518] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:40:48 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:48.516752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09037ad-fff1-4cd1-8137-73c80cde8666 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.528104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09037ad-fff1-4cd1-8137-73c80cde8666 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.552579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:48.585661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3545dcb-2a3b-4002-b8c8-411f116f1dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.586796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3545dcb-2a3b-4002-b8c8-411f116f1dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.587080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3545dcb-2a3b-4002-b8c8-411f116f1dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.587355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3545dcb-2a3b-4002-b8c8-411f116f1dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.588029 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3545dcb-2a3b-4002-b8c8-411f116f1dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.589971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3545dcb-2a3b-4002-b8c8-411f116f1dd4 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.615576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1260/2519] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:40:48 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:48.616736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51482372-5cb5-4f03-9ed1-c398799abc77 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.627313 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51482372-5cb5-4f03-9ed1-c398799abc77 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.632259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0ecba-13a4-4278-8d55-a9b50414d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.632864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ecba-13a4-4278-8d55-a9b50414d7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.633170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ecba-13a4-4278-8d55-a9b50414d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.633485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ecba-13a4-4278-8d55-a9b50414d7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.634169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0ecba-13a4-4278-8d55-a9b50414d7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.635766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0ecba-13a4-4278-8d55-a9b50414d7f7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.646235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1260/2520] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:48.650664 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3545dcb-2a3b-4002-b8c8-411f116f1dd4 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.660377 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3545dcb-2a3b-4002-b8c8-411f116f1dd4 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.665518 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12bb7-3872-4b58-aa47-1151fddac910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.666162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12bb7-3872-4b58-aa47-1151fddac910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.666439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12bb7-3872-4b58-aa47-1151fddac910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.666711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12bb7-3872-4b58-aa47-1151fddac910 admin admin] PATH_INFO: `/v3/projects/f867aaf279cb4cd5b3dd72eb51e3ecf2/users/c7f56c15de164069adfc616d4e7d4332/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.681080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff12bb7-3872-4b58-aa47-1151fddac910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f867aaf279cb4cd5b3dd72eb51e3ecf2, user_id=c7f56c15de164069adfc616d4e7d4332, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.683742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff12bb7-3872-4b58-aa47-1151fddac910 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.696193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1261/2521] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:48 2022] PUT /identity/v3/projects/f867aaf279cb4cd5b3dd72eb51e3ecf2/users/c7f56c15de164069adfc616d4e7d4332/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:48.699996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0ecba-13a4-4278-8d55-a9b50414d7f7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.709885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0ecba-13a4-4278-8d55-a9b50414d7f7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.765278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92b165-fb1d-42f0-8929-88744738fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.765846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92b165-fb1d-42f0-8929-88744738fa5d admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.766127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92b165-fb1d-42f0-8929-88744738fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.766399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92b165-fb1d-42f0-8929-88744738fa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.767068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92b165-fb1d-42f0-8929-88744738fa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.768661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92b165-fb1d-42f0-8929-88744738fa5d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.778593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1261/2522] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:48.782702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12bb7-3872-4b58-aa47-1151fddac910 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.793558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12bb7-3872-4b58-aa47-1151fddac910 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.798237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9973ff-a246-4aac-89a1-310419d6ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.798888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9973ff-a246-4aac-89a1-310419d6ff97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.799167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9973ff-a246-4aac-89a1-310419d6ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.799443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9973ff-a246-4aac-89a1-310419d6ff97 admin admin] PATH_INFO: `/v3/projects/f867aaf279cb4cd5b3dd72eb51e3ecf2/users/c7f56c15de164069adfc616d4e7d4332/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.801445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9973ff-a246-4aac-89a1-310419d6ff97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f867aaf279cb4cd5b3dd72eb51e3ecf2, user_id=c7f56c15de164069adfc616d4e7d4332, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:48.804050 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9973ff-a246-4aac-89a1-310419d6ff97 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:48.814066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1262/2523] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:48 2022] PUT /identity/v3/projects/f867aaf279cb4cd5b3dd72eb51e3ecf2/users/c7f56c15de164069adfc616d4e7d4332/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:48.824004 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411a9fe-8a2c-4971-b11e-b7a4b2a59bfd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.824292 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411a9fe-8a2c-4971-b11e-b7a4b2a59bfd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.824569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411a9fe-8a2c-4971-b11e-b7a4b2a59bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:48.853139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a411a9fe-8a2c-4971-b11e-b7a4b2a59bfd None None] MFA Rules not processed for user `c7f56c15de164069adfc616d4e7d4332`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:48.854365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a411a9fe-8a2c-4971-b11e-b7a4b2a59bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:48.921598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1262/2524] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:48.932799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9973ff-a246-4aac-89a1-310419d6ff97 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:48.934572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1f9973ff-a246-4aac-89a1-310419d6ff97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:48.991662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9973ff-a246-4aac-89a1-310419d6ff97 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:48.995253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893e0de-ea5f-44bb-b4da-edef43de8f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:48.995850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893e0de-ea5f-44bb-b4da-edef43de8f4a service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:48.996124 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893e0de-ea5f-44bb-b4da-edef43de8f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:48.996394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893e0de-ea5f-44bb-b4da-edef43de8f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:49.005439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893e0de-ea5f-44bb-b4da-edef43de8f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:49.006838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893e0de-ea5f-44bb-b4da-edef43de8f4a service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:49.016587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1263/2525] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:49.059868 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411a9fe-8a2c-4971-b11e-b7a4b2a59bfd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:49.061256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a411a9fe-8a2c-4971-b11e-b7a4b2a59bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:49.074159 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411a9fe-8a2c-4971-b11e-b7a4b2a59bfd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:49.077786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0290717-8add-41fc-be85-39958c439ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:49.078391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290717-8add-41fc-be85-39958c439ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:49.078692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290717-8add-41fc-be85-39958c439ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:49.078947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0290717-8add-41fc-be85-39958c439ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:49.128765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:49.139097 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0290717-8add-41fc-be85-39958c439ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:49.140526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0290717-8add-41fc-be85-39958c439ac8 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:49.149974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1263/2526] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:49.448398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893e0de-ea5f-44bb-b4da-edef43de8f4a service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:49.449844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8893e0de-ea5f-44bb-b4da-edef43de8f4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:49.526028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893e0de-ea5f-44bb-b4da-edef43de8f4a service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:49.529623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:49.530231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:49.530513 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:49.530791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:49.532688 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:49.577538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:49.617082 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:49.619382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:49.634074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1264/2527] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:49.705136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2988139-1d04-4aac-ad13-6cd7f594d724 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:49.705659 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2988139-1d04-4aac-ad13-6cd7f594d724 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:49.705775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2988139-1d04-4aac-ad13-6cd7f594d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:49.725466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b2988139-1d04-4aac-ad13-6cd7f594d724 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:49.726664 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b2988139-1d04-4aac-ad13-6cd7f594d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:49.785273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1264/2528] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:40:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:49.830577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:49.832027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:49.901428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da223903-0c2b-4429-bc93-2b649e3cf2a6 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:49.906371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4ddcd-37a3-412a-9c60-1ccdf554aedb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:49.906974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4ddcd-37a3-412a-9c60-1ccdf554aedb service swift] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:49.907251 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4ddcd-37a3-412a-9c60-1ccdf554aedb service swift] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:49.907519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4ddcd-37a3-412a-9c60-1ccdf554aedb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:49.915705 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4ddcd-37a3-412a-9c60-1ccdf554aedb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:49.917302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4ddcd-37a3-412a-9c60-1ccdf554aedb service swift] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:49.925875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1265/2529] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:40:52.861469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2988139-1d04-4aac-ad13-6cd7f594d724 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:52.940009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2988139-1d04-4aac-ad13-6cd7f594d724 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:52.944077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:52.944851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:52.945138 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:52.946142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] PATH_INFO: `/v3/users/9edfa1ab9ea74c79bbb48ae9d8bb57e5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:52.947334 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9edfa1ab9ea74c79bbb48ae9d8bb57e5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:52.949272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:53.008336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9edfa1ab9ea74c79bbb48ae9d8bb57e5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.017795 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9edfa1ab9ea74c79bbb48ae9d8bb57e5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.029035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9edfa1ab9ea74c79bbb48ae9d8bb57e5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.029816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9edfa1ab9ea74c79bbb48ae9d8bb57e5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.030434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9edfa1ab9ea74c79bbb48ae9d8bb57e5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.055726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1265/2530] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:40:52 2022] DELETE /identity/v3/users/9edfa1ab9ea74c79bbb48ae9d8bb57e5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:53.064893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1ac34-3342-4f23-996c-df9b09760abb None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:53.065466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1ac34-3342-4f23-996c-df9b09760abb None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:53.065466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1ac34-3342-4f23-996c-df9b09760abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:53.087587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-07a1ac34-3342-4f23-996c-df9b09760abb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:53.088834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-07a1ac34-3342-4f23-996c-df9b09760abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:53.169442 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1266/2531] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:53.180073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:53.181551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:53.210442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:53.264049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eef514-2e71-4306-93ab-942b0dde2962 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:53.271002 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416a0e1-3255-4d92-8640-b8f063cb9943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:53.271862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416a0e1-3255-4d92-8640-b8f063cb9943 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:53.272343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416a0e1-3255-4d92-8640-b8f063cb9943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:53.272788 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416a0e1-3255-4d92-8640-b8f063cb9943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:53.288999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416a0e1-3255-4d92-8640-b8f063cb9943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:53.291104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416a0e1-3255-4d92-8640-b8f063cb9943 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:53.302252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1266/2532] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:53.700884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1ac34-3342-4f23-996c-df9b09760abb None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:53.702324 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-07a1ac34-3342-4f23-996c-df9b09760abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:53.740531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1ac34-3342-4f23-996c-df9b09760abb None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:53.749383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:53.750064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:53.750342 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:53.750621 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] PATH_INFO: `/v3/projects/ad4c188dd0cc47c3a70f221ab2c07099` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:53.757151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4c188dd0cc47c3a70f221ab2c07099)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:53.759337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:53.816905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:53.821885 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4c188dd0cc47c3a70f221ab2c07099', 'request_id': 'req-836445ed-0953-421f-83a4-8fc74bcf09c0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.831598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4c188dd0cc47c3a70f221ab2c07099', 'request_id': 'req-836445ed-0953-421f-83a4-8fc74bcf09c0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.840739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4c188dd0cc47c3a70f221ab2c07099', 'request_id': 'req-836445ed-0953-421f-83a4-8fc74bcf09c0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.855658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] The token cache is being invalidate because project ad4c188dd0cc47c3a70f221ab2c07099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:40:53.855973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.856608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:53.858470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1267/2533] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:40:53 2022] DELETE /identity/v3/projects/ad4c188dd0cc47c3a70f221ab2c07099 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:53.862812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416a0e1-3255-4d92-8640-b8f063cb9943 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:53.875006 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416a0e1-3255-4d92-8640-b8f063cb9943 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:53.939724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:53.940456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:53.940852 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:53.941136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] PATH_INFO: `/v3/users/c7f56c15de164069adfc616d4e7d4332` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:53.942357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f56c15de164069adfc616d4e7d4332)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:53.944295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:54.009805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f56c15de164069adfc616d4e7d4332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.021786 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f56c15de164069adfc616d4e7d4332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.030477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f56c15de164069adfc616d4e7d4332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.031183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f56c15de164069adfc616d4e7d4332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.031847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-07e5d24c-d467-4782-8ff5-2f09103219e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f56c15de164069adfc616d4e7d4332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.052633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1267/2534] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:40:53 2022] DELETE /identity/v3/users/c7f56c15de164069adfc616d4e7d4332 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:54.365610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:54.369280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:54.385216 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836445ed-0953-421f-83a4-8fc74bcf09c0 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:54.458168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:54.458890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:54.459180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:54.459516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] PATH_INFO: `/v3/projects/f867aaf279cb4cd5b3dd72eb51e3ecf2` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:54.461690 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f867aaf279cb4cd5b3dd72eb51e3ecf2)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:54.463786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:54.527536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f867aaf279cb4cd5b3dd72eb51e3ecf2', 'request_id': 'req-9f1084ea-339a-4a1c-aea8-d1acc47214e9'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.539382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f867aaf279cb4cd5b3dd72eb51e3ecf2', 'request_id': 'req-9f1084ea-339a-4a1c-aea8-d1acc47214e9'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.548411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f867aaf279cb4cd5b3dd72eb51e3ecf2', 'request_id': 'req-9f1084ea-339a-4a1c-aea8-d1acc47214e9'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.564962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] The token cache is being invalidate because project f867aaf279cb4cd5b3dd72eb51e3ecf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:40:54.565959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.567758 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-9f1084ea-339a-4a1c-aea8-d1acc47214e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:40:54.571761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1268/2535] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:40:54 2022] DELETE /identity/v3/projects/f867aaf279cb4cd5b3dd72eb51e3ecf2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:54.577072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616f51b-df52-49a1-bea8-1ba57c36b154 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:54.578005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616f51b-df52-49a1-bea8-1ba57c36b154 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:54.579181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616f51b-df52-49a1-bea8-1ba57c36b154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:54.605216 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8616f51b-df52-49a1-bea8-1ba57c36b154 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:54.606665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8616f51b-df52-49a1-bea8-1ba57c36b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:54.651736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:54.694147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1268/2536] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:54.705455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded186c-56d1-4f0a-bc64-73a48ca312e3 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:54.705455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded186c-56d1-4f0a-bc64-73a48ca312e3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:54.705455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded186c-56d1-4f0a-bc64-73a48ca312e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:54.725484 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-fded186c-56d1-4f0a-bc64-73a48ca312e3 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:54.726746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fded186c-56d1-4f0a-bc64-73a48ca312e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:54.737433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1269/2537] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:54.741650 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616f51b-df52-49a1-bea8-1ba57c36b154 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:54.754441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616f51b-df52-49a1-bea8-1ba57c36b154 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:54.759731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7183977-47aa-4eaa-9cb4-f46732bfbe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:54.760356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7183977-47aa-4eaa-9cb4-f46732bfbe83 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:54.760637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7183977-47aa-4eaa-9cb4-f46732bfbe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:54.760910 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7183977-47aa-4eaa-9cb4-f46732bfbe83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:54.761639 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7183977-47aa-4eaa-9cb4-f46732bfbe83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:40:54.761944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7183977-47aa-4eaa-9cb4-f46732bfbe83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:54.763668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7183977-47aa-4eaa-9cb4-f46732bfbe83 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:54.781371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1269/2538] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:40:54.785283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded186c-56d1-4f0a-bc64-73a48ca312e3 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:54.794361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded186c-56d1-4f0a-bc64-73a48ca312e3 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:54.799846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9097268-5681-4010-90c5-1fa531a62fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:54.800456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9097268-5681-4010-90c5-1fa531a62fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:54.800752 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9097268-5681-4010-90c5-1fa531a62fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:54.801021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9097268-5681-4010-90c5-1fa531a62fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:54.801786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9097268-5681-4010-90c5-1fa531a62fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:54.803662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9097268-5681-4010-90c5-1fa531a62fc9 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:54.839357 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1270/2539] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:40:54 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:40:54.840648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7183977-47aa-4eaa-9cb4-f46732bfbe83 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:54.855408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7183977-47aa-4eaa-9cb4-f46732bfbe83 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:54.929531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd495b-f62b-40e8-a04a-d258379ee406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:54.931496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd495b-f62b-40e8-a04a-d258379ee406 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:54.931937 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd495b-f62b-40e8-a04a-d258379ee406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:54.932407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd495b-f62b-40e8-a04a-d258379ee406 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:54.933301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd495b-f62b-40e8-a04a-d258379ee406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:54.936670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd495b-f62b-40e8-a04a-d258379ee406 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:54.972017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1270/2540] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:40:54 2022] POST /identity/v3/users => generated 305 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:40:54.973411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9097268-5681-4010-90c5-1fa531a62fc9 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:54.985117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9097268-5681-4010-90c5-1fa531a62fc9 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:54.990063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f414bc-c01d-442f-a8d8-59be09e46dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:54.990668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f414bc-c01d-442f-a8d8-59be09e46dec admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:54.990961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f414bc-c01d-442f-a8d8-59be09e46dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:54.991230 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f414bc-c01d-442f-a8d8-59be09e46dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:54.991924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f414bc-c01d-442f-a8d8-59be09e46dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:54.994126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f414bc-c01d-442f-a8d8-59be09e46dec admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:55.012739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1271/2541] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:55.013973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd495b-f62b-40e8-a04a-d258379ee406 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:55.025271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd495b-f62b-40e8-a04a-d258379ee406 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:55.030347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d369b5-febb-4312-8af7-231c25d7403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:55.030971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d369b5-febb-4312-8af7-231c25d7403f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.031275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d369b5-febb-4312-8af7-231c25d7403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.031529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d369b5-febb-4312-8af7-231c25d7403f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.032368 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d369b5-febb-4312-8af7-231c25d7403f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:55.034007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d369b5-febb-4312-8af7-231c25d7403f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:55.048297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1271/2542] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:55.052287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f414bc-c01d-442f-a8d8-59be09e46dec admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:55.066483 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f414bc-c01d-442f-a8d8-59be09e46dec admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:55.071196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a4c5f-f9ca-47cd-8665-8023b52467f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:55.071871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a4c5f-f9ca-47cd-8665-8023b52467f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.072155 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a4c5f-f9ca-47cd-8665-8023b52467f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.072431 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a4c5f-f9ca-47cd-8665-8023b52467f0 admin admin] PATH_INFO: `/v3/projects/da15d45e4d384977b97ef396eb018a26/users/998eb4c4505a4d32af11d0f06a928c72/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.092036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a4c5f-f9ca-47cd-8665-8023b52467f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da15d45e4d384977b97ef396eb018a26, user_id=998eb4c4505a4d32af11d0f06a928c72, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:55.094780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a4c5f-f9ca-47cd-8665-8023b52467f0 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:55.114835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1272/2543] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:55 2022] PUT /identity/v3/projects/da15d45e4d384977b97ef396eb018a26/users/998eb4c4505a4d32af11d0f06a928c72/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:55.126535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7779c-e812-4471-b3b2-8231fbde7dcb None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.126825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7779c-e812-4471-b3b2-8231fbde7dcb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.127110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7779c-e812-4471-b3b2-8231fbde7dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.161808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7eb7779c-e812-4471-b3b2-8231fbde7dcb None None] MFA Rules not processed for user `998eb4c4505a4d32af11d0f06a928c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:55.163082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7eb7779c-e812-4471-b3b2-8231fbde7dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:55.240424 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1272/2544] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:55 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:55.246276 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a4c5f-f9ca-47cd-8665-8023b52467f0 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:55.251485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:55.331360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a4c5f-f9ca-47cd-8665-8023b52467f0 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:55.336975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e33d-e81d-4035-a1a6-00cc945d26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:55.337657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e33d-e81d-4035-a1a6-00cc945d26fc admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.337937 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e33d-e81d-4035-a1a6-00cc945d26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.338218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e33d-e81d-4035-a1a6-00cc945d26fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.338905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e33d-e81d-4035-a1a6-00cc945d26fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:55.340962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e33d-e81d-4035-a1a6-00cc945d26fc admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:55.375064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1273/2545] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:40:55 2022] POST /identity/v3/projects => generated 409 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:40:55.379332 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7779c-e812-4471-b3b2-8231fbde7dcb None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:55.391317 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7779c-e812-4471-b3b2-8231fbde7dcb None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:55.428609 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:55.460544 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c333d6-1eb6-4e52-8964-b2fd8e394ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:55.462204 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c333d6-1eb6-4e52-8964-b2fd8e394ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.462692 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c333d6-1eb6-4e52-8964-b2fd8e394ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.463159 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c333d6-1eb6-4e52-8964-b2fd8e394ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.464390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c333d6-1eb6-4e52-8964-b2fd8e394ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:55.467859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c333d6-1eb6-4e52-8964-b2fd8e394ed1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:55.527870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1273/2546] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:40:55 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:40:55.531868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e33d-e81d-4035-a1a6-00cc945d26fc admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:55.543156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e33d-e81d-4035-a1a6-00cc945d26fc admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:55.547776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285106ef-72bf-46fb-9a60-29ac8d295236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:55.548381 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285106ef-72bf-46fb-9a60-29ac8d295236 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.548734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285106ef-72bf-46fb-9a60-29ac8d295236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.549101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285106ef-72bf-46fb-9a60-29ac8d295236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.549868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285106ef-72bf-46fb-9a60-29ac8d295236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:55.551562 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285106ef-72bf-46fb-9a60-29ac8d295236 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:55.568895 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1274/2547] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:55.571148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c333d6-1eb6-4e52-8964-b2fd8e394ed1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:55.583127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c333d6-1eb6-4e52-8964-b2fd8e394ed1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:55.588507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ede0-78ea-4559-a058-b03cf39d77e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:55.589418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ede0-78ea-4559-a058-b03cf39d77e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.589912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ede0-78ea-4559-a058-b03cf39d77e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.590348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028ede0-78ea-4559-a058-b03cf39d77e1 admin admin] PATH_INFO: `/v3/projects/4b056a815a5841a1a9e744f093cd8032/users/9dafc5d26a08446284bcf4b6a193cda2/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.607799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028ede0-78ea-4559-a058-b03cf39d77e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b056a815a5841a1a9e744f093cd8032, user_id=9dafc5d26a08446284bcf4b6a193cda2, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:55.610516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028ede0-78ea-4559-a058-b03cf39d77e1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:55.627178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1274/2548] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:55 2022] PUT /identity/v3/projects/4b056a815a5841a1a9e744f093cd8032/users/9dafc5d26a08446284bcf4b6a193cda2/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:55.632709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285106ef-72bf-46fb-9a60-29ac8d295236 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:55.643503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285106ef-72bf-46fb-9a60-29ac8d295236 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:55.709819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adbe18-5661-495b-a28b-b3f6b045fe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:55.710465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adbe18-5661-495b-a28b-b3f6b045fe95 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.710742 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adbe18-5661-495b-a28b-b3f6b045fe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.711044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adbe18-5661-495b-a28b-b3f6b045fe95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.711731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adbe18-5661-495b-a28b-b3f6b045fe95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:55.713367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adbe18-5661-495b-a28b-b3f6b045fe95 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:55.726189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1275/2549] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:40:55.731033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ede0-78ea-4559-a058-b03cf39d77e1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:55.742560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028ede0-78ea-4559-a058-b03cf39d77e1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:55.748275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab242eb-7608-44f9-a04b-6c7e07c64d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:55.749196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab242eb-7608-44f9-a04b-6c7e07c64d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.749683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab242eb-7608-44f9-a04b-6c7e07c64d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.750166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab242eb-7608-44f9-a04b-6c7e07c64d99 admin admin] PATH_INFO: `/v3/projects/4b056a815a5841a1a9e744f093cd8032/users/9dafc5d26a08446284bcf4b6a193cda2/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.752373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab242eb-7608-44f9-a04b-6c7e07c64d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b056a815a5841a1a9e744f093cd8032, user_id=9dafc5d26a08446284bcf4b6a193cda2, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:55.755289 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab242eb-7608-44f9-a04b-6c7e07c64d99 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:55.768382 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1275/2550] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:40:55 2022] PUT /identity/v3/projects/4b056a815a5841a1a9e744f093cd8032/users/9dafc5d26a08446284bcf4b6a193cda2/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:40:55.780044 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d567-0bec-4e01-ae53-1a1ea88b200a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.780611 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d567-0bec-4e01-ae53-1a1ea88b200a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.781094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d567-0bec-4e01-ae53-1a1ea88b200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:55.822386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2315d567-0bec-4e01-ae53-1a1ea88b200a None None] MFA Rules not processed for user `9dafc5d26a08446284bcf4b6a193cda2`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:40:55.823675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2315d567-0bec-4e01-ae53-1a1ea88b200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:55.901784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:55.917356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1276/2551] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:40:55 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:40:55.921261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab242eb-7608-44f9-a04b-6c7e07c64d99 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:55.922512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2ab242eb-7608-44f9-a04b-6c7e07c64d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:55.985732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab242eb-7608-44f9-a04b-6c7e07c64d99 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:55.990429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4edbb-143f-499a-be51-eec3051b5f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:55.991040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4edbb-143f-499a-be51-eec3051b5f4a service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:55.991462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4edbb-143f-499a-be51-eec3051b5f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:55.991736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4edbb-143f-499a-be51-eec3051b5f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:56.003329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4edbb-143f-499a-be51-eec3051b5f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:56.004891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4edbb-143f-499a-be51-eec3051b5f4a service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:56.016974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1276/2552] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:55 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:56.205952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d567-0bec-4e01-ae53-1a1ea88b200a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:56.216556 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d567-0bec-4e01-ae53-1a1ea88b200a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:56.222836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59994-32e7-42af-b060-de66747ec9ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:56.223486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59994-32e7-42af-b060-de66747ec9ea service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:56.223998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59994-32e7-42af-b060-de66747ec9ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:56.224275 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59994-32e7-42af-b060-de66747ec9ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:56.295385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a59994-32e7-42af-b060-de66747ec9ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:56.297086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a59994-32e7-42af-b060-de66747ec9ea service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:56.306883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1277/2553] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:56 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:40:58.988159 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4edbb-143f-499a-be51-eec3051b5f4a service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:40:58.989656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cce4edbb-143f-499a-be51-eec3051b5f4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:59.047651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4edbb-143f-499a-be51-eec3051b5f4a service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:40:59.051225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32538ab8-46c9-4010-90e2-bcf18965f707 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2ef9088a9941ddb4b163f282a1f7d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:40:59.051836 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538ab8-46c9-4010-90e2-bcf18965f707 service glance] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:40:59.052114 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538ab8-46c9-4010-90e2-bcf18965f707 service glance] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:40:59.052384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538ab8-46c9-4010-90e2-bcf18965f707 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:40:59.054325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-32538ab8-46c9-4010-90e2-bcf18965f707 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:40:59.098144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:40:59.115971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32538ab8-46c9-4010-90e2-bcf18965f707 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:40:59.118113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32538ab8-46c9-4010-90e2-bcf18965f707 service glance] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:40:59.127972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1277/2554] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:40:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:01.646685 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59994-32e7-42af-b060-de66747ec9ea service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:01.712168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59994-32e7-42af-b060-de66747ec9ea service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:01.719231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:01.719948 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:01.720305 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:01.720643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] PATH_INFO: `/v3/users/998eb4c4505a4d32af11d0f06a928c72` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:01.721977 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=998eb4c4505a4d32af11d0f06a928c72)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:01.723991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:01.779630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998eb4c4505a4d32af11d0f06a928c72'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:01.789662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998eb4c4505a4d32af11d0f06a928c72'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:01.796780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998eb4c4505a4d32af11d0f06a928c72'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:01.797562 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998eb4c4505a4d32af11d0f06a928c72'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:01.811740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998eb4c4505a4d32af11d0f06a928c72'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:01.820188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1278/2555] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:01 2022] DELETE /identity/v3/users/998eb4c4505a4d32af11d0f06a928c72 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:01.823360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0eb7-9b44-410c-980c-6d20473734e2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:01.823810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0eb7-9b44-410c-980c-6d20473734e2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:01.823946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0eb7-9b44-410c-980c-6d20473734e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:01.843082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e3bd0eb7-9b44-410c-980c-6d20473734e2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:01.844355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e3bd0eb7-9b44-410c-980c-6d20473734e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:01.906698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1278/2556] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:01.916721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:01.918148 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:01.937095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:02.111419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc059af3-9738-482e-b0dc-aa071d2f5c94 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:02.115104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36a31-4e6e-41de-bee0-5b6d96f82395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:02.115721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36a31-4e6e-41de-bee0-5b6d96f82395 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:02.115996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36a31-4e6e-41de-bee0-5b6d96f82395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:02.116264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36a31-4e6e-41de-bee0-5b6d96f82395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:02.125817 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a36a31-4e6e-41de-bee0-5b6d96f82395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:02.127228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a36a31-4e6e-41de-bee0-5b6d96f82395 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:02.138246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1279/2557] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:02.417656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd0eb7-9b44-410c-980c-6d20473734e2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:02.419138 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e3bd0eb7-9b44-410c-980c-6d20473734e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:02.437453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd0eb7-9b44-410c-980c-6d20473734e2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:02.443104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:02.443728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:02.444039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:02.444255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] PATH_INFO: `/v3/projects/da15d45e4d384977b97ef396eb018a26` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:02.445909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da15d45e4d384977b97ef396eb018a26)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:02.447857 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:02.494303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da15d45e4d384977b97ef396eb018a26', 'request_id': 'req-b166998b-26e2-4911-8242-8b8c7b4b3056'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.502263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da15d45e4d384977b97ef396eb018a26', 'request_id': 'req-b166998b-26e2-4911-8242-8b8c7b4b3056'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.508551 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da15d45e4d384977b97ef396eb018a26', 'request_id': 'req-b166998b-26e2-4911-8242-8b8c7b4b3056'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.519314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] The token cache is being invalidate because project da15d45e4d384977b97ef396eb018a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:02.519602 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.520226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.521749 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1279/2558] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:02 2022] DELETE /identity/v3/projects/da15d45e4d384977b97ef396eb018a26 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:02.526350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36a31-4e6e-41de-bee0-5b6d96f82395 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:02.535816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36a31-4e6e-41de-bee0-5b6d96f82395 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:02.591574 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:02.592200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:02.592493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:02.592744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] PATH_INFO: `/v3/users/9dafc5d26a08446284bcf4b6a193cda2` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:02.593915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dafc5d26a08446284bcf4b6a193cda2)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:02.595788 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:02.640330 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dafc5d26a08446284bcf4b6a193cda2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.647662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dafc5d26a08446284bcf4b6a193cda2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.656007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dafc5d26a08446284bcf4b6a193cda2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.656757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dafc5d26a08446284bcf4b6a193cda2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.669312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-959c6e1f-0531-419f-bfe2-b3abbaf266d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dafc5d26a08446284bcf4b6a193cda2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:02.675156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1280/2559] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:02 2022] DELETE /identity/v3/users/9dafc5d26a08446284bcf4b6a193cda2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:03.023101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.024679 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:03.038669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166998b-26e2-4911-8242-8b8c7b4b3056 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:03.115892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:03.117741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.117741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.117969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] PATH_INFO: `/v3/projects/4b056a815a5841a1a9e744f093cd8032` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.119117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b056a815a5841a1a9e744f093cd8032)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:03.121805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:03.131477 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:03.180518 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b056a815a5841a1a9e744f093cd8032', 'request_id': 'req-844ae921-ef94-4e12-8307-7d1538776625'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:03.190845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b056a815a5841a1a9e744f093cd8032', 'request_id': 'req-844ae921-ef94-4e12-8307-7d1538776625'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:03.197736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b056a815a5841a1a9e744f093cd8032', 'request_id': 'req-844ae921-ef94-4e12-8307-7d1538776625'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:03.221798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] The token cache is being invalidate because project 4b056a815a5841a1a9e744f093cd8032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:03.222180 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:03.222926 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-844ae921-ef94-4e12-8307-7d1538776625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:03.224971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1280/2560] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:03 2022] DELETE /identity/v3/projects/4b056a815a5841a1a9e744f093cd8032 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:03.230356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049383-8a50-4d76-bbfc-3b4e274ff891 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.230631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049383-8a50-4d76-bbfc-3b4e274ff891 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.230898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049383-8a50-4d76-bbfc-3b4e274ff891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.252975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b8049383-8a50-4d76-bbfc-3b4e274ff891 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:03.254207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b8049383-8a50-4d76-bbfc-3b4e274ff891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:03.299825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:03.341542 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1281/2561] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:03.343183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49465-ac01-4cc6-9aee-37a5686049d2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.343475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49465-ac01-4cc6-9aee-37a5686049d2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.343746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49465-ac01-4cc6-9aee-37a5686049d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.364656 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-78a49465-ac01-4cc6-9aee-37a5686049d2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:03.366128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-78a49465-ac01-4cc6-9aee-37a5686049d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:03.378171 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1281/2562] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:03.382981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8049383-8a50-4d76-bbfc-3b4e274ff891 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.394367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8049383-8a50-4d76-bbfc-3b4e274ff891 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:03.399230 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72552dfb-bf82-4c92-a583-22facda794fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:03.399847 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72552dfb-bf82-4c92-a583-22facda794fe admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.400157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72552dfb-bf82-4c92-a583-22facda794fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.400398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72552dfb-bf82-4c92-a583-22facda794fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.401102 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72552dfb-bf82-4c92-a583-22facda794fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:03.401459 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72552dfb-bf82-4c92-a583-22facda794fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:03.403010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72552dfb-bf82-4c92-a583-22facda794fe admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:03.416537 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1282/2563] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:03.420861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49465-ac01-4cc6-9aee-37a5686049d2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.433112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49465-ac01-4cc6-9aee-37a5686049d2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:03.437390 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f2416-a0f5-45db-a94f-bbd94e67d803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:03.438109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f2416-a0f5-45db-a94f-bbd94e67d803 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.438564 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f2416-a0f5-45db-a94f-bbd94e67d803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.438989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f2416-a0f5-45db-a94f-bbd94e67d803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.439907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f2416-a0f5-45db-a94f-bbd94e67d803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:03.442203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f2416-a0f5-45db-a94f-bbd94e67d803 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:03.475320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1282/2564] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:03 2022] POST /identity/v3/projects => generated 357 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:03.480045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72552dfb-bf82-4c92-a583-22facda794fe admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.490587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72552dfb-bf82-4c92-a583-22facda794fe admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:03.577517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a746a-cbf2-40ef-9e34-0badad013d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:03.578169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a746a-cbf2-40ef-9e34-0badad013d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.578500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a746a-cbf2-40ef-9e34-0badad013d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.578777 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a746a-cbf2-40ef-9e34-0badad013d6c admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.579648 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a746a-cbf2-40ef-9e34-0badad013d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:03.581555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a746a-cbf2-40ef-9e34-0badad013d6c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:03.607086 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1283/2565] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:03 2022] POST /identity/v3/users => generated 279 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:03.611190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f2416-a0f5-45db-a94f-bbd94e67d803 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.627493 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f2416-a0f5-45db-a94f-bbd94e67d803 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:03.632994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ffb94-2910-4b8a-bd95-46a64a4b5ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:03.633645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ffb94-2910-4b8a-bd95-46a64a4b5ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.633928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ffb94-2910-4b8a-bd95-46a64a4b5ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.634203 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ffb94-2910-4b8a-bd95-46a64a4b5ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.635019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ffb94-2910-4b8a-bd95-46a64a4b5ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:03.636698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ffb94-2910-4b8a-bd95-46a64a4b5ccc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:03.649920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1283/2566] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:03.653943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a746a-cbf2-40ef-9e34-0badad013d6c admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.666004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a746a-cbf2-40ef-9e34-0badad013d6c admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:03.670916 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949e986-7c3e-4a12-aa85-0402405e3387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:03.671622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949e986-7c3e-4a12-aa85-0402405e3387 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.672037 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949e986-7c3e-4a12-aa85-0402405e3387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.672320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949e986-7c3e-4a12-aa85-0402405e3387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.673008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949e986-7c3e-4a12-aa85-0402405e3387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:03.674608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949e986-7c3e-4a12-aa85-0402405e3387 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:03.685273 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1284/2567] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:03.689473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ffb94-2910-4b8a-bd95-46a64a4b5ccc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.700439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ffb94-2910-4b8a-bd95-46a64a4b5ccc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:03.707649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742bc4a-de4c-45c8-b1fd-df6e216bfcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:03.708338 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742bc4a-de4c-45c8-b1fd-df6e216bfcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.708614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742bc4a-de4c-45c8-b1fd-df6e216bfcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.708883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742bc4a-de4c-45c8-b1fd-df6e216bfcf7 admin admin] PATH_INFO: `/v3/projects/bf4503eca8f14ceb988dfad9c8efddf0/users/405b6dff4409434d9856eda6c18b33f0/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.727160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742bc4a-de4c-45c8-b1fd-df6e216bfcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4503eca8f14ceb988dfad9c8efddf0, user_id=405b6dff4409434d9856eda6c18b33f0, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:03.733540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742bc4a-de4c-45c8-b1fd-df6e216bfcf7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:03.746668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1284/2568] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:03 2022] PUT /identity/v3/projects/bf4503eca8f14ceb988dfad9c8efddf0/users/405b6dff4409434d9856eda6c18b33f0/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:03.757536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287651-0d18-4d85-ab14-a9bda8123f3e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.757826 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287651-0d18-4d85-ab14-a9bda8123f3e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.758158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287651-0d18-4d85-ab14-a9bda8123f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.785718 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-e5287651-0d18-4d85-ab14-a9bda8123f3e None None] MFA Rules not processed for user `405b6dff4409434d9856eda6c18b33f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:03.786988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e5287651-0d18-4d85-ab14-a9bda8123f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:03.857191 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1285/2569] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:03.889942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742bc4a-de4c-45c8-b1fd-df6e216bfcf7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.891634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5742bc4a-de4c-45c8-b1fd-df6e216bfcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:03.953866 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5287651-0d18-4d85-ab14-a9bda8123f3e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.954773 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742bc4a-de4c-45c8-b1fd-df6e216bfcf7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:03.955405 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e5287651-0d18-4d85-ab14-a9bda8123f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:03.958473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732928c-d622-41e1-ba2b-45ff2c2ead1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:03.959089 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732928c-d622-41e1-ba2b-45ff2c2ead1a service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:03.959366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732928c-d622-41e1-ba2b-45ff2c2ead1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:03.959641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732928c-d622-41e1-ba2b-45ff2c2ead1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:03.969541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732928c-d622-41e1-ba2b-45ff2c2ead1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:03.971036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732928c-d622-41e1-ba2b-45ff2c2ead1a service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:03.981223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1285/2570] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:03.997311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732928c-d622-41e1-ba2b-45ff2c2ead1a service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:03.998979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:04.033257 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5287651-0d18-4d85-ab14-a9bda8123f3e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:04.036911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf2e39-64cb-4da9-b2f0-add168e0f558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:04.037554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2e39-64cb-4da9-b2f0-add168e0f558 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.037830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2e39-64cb-4da9-b2f0-add168e0f558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.038101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2e39-64cb-4da9-b2f0-add168e0f558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.039944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f6cf2e39-64cb-4da9-b2f0-add168e0f558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.042736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:04.054489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf2e39-64cb-4da9-b2f0-add168e0f558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:04.056188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf2e39-64cb-4da9-b2f0-add168e0f558 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:04.066400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1286/2571] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:04.089793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732928c-d622-41e1-ba2b-45ff2c2ead1a service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:04.095882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:04.096586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.096869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.097559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] PATH_INFO: `/v3/users/405b6dff4409434d9856eda6c18b33f0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.098760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=405b6dff4409434d9856eda6c18b33f0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:04.100987 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:04.169855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405b6dff4409434d9856eda6c18b33f0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.178770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405b6dff4409434d9856eda6c18b33f0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.189962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405b6dff4409434d9856eda6c18b33f0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.190724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405b6dff4409434d9856eda6c18b33f0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.191345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-2904c68f-3b0f-4043-9553-93e250aa7b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405b6dff4409434d9856eda6c18b33f0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.220889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1286/2572] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:03 2022] DELETE /identity/v3/users/405b6dff4409434d9856eda6c18b33f0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:41:04.225153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf97f8-54e8-4b06-934c-c35691ef270a None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.225489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf97f8-54e8-4b06-934c-c35691ef270a None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.225768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf97f8-54e8-4b06-934c-c35691ef270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.243428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c74fb8-f878-4c3c-b04d-dbc9c2936dd1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.243809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c74fb8-f878-4c3c-b04d-dbc9c2936dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.244098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c74fb8-f878-4c3c-b04d-dbc9c2936dd1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.246447 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1287/2573] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:41:04.257975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-69cf97f8-54e8-4b06-934c-c35691ef270a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:04.257975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-69cf97f8-54e8-4b06-934c-c35691ef270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.265730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fbbcf-eca2-474e-8678-58858666c36c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.266352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fbbcf-eca2-474e-8678-58858666c36c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.266915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fbbcf-eca2-474e-8678-58858666c36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.291920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-445fbbcf-eca2-474e-8678-58858666c36c None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:04.293388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-445fbbcf-eca2-474e-8678-58858666c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.338663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1287/2574] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:04.348152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf97f8-54e8-4b06-934c-c35691ef270a None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:04.349593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-69cf97f8-54e8-4b06-934c-c35691ef270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.387190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1288/2575] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:04.401359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fbbcf-eca2-474e-8678-58858666c36c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:04.402948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-445fbbcf-eca2-474e-8678-58858666c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.412904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf97f8-54e8-4b06-934c-c35691ef270a None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:04.417482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b1626-eeda-4b3a-bb79-b54bf47f70c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:04.418274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b1626-eeda-4b3a-bb79-b54bf47f70c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.418839 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b1626-eeda-4b3a-bb79-b54bf47f70c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.419264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b1626-eeda-4b3a-bb79-b54bf47f70c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.428971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b1626-eeda-4b3a-bb79-b54bf47f70c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:04.430886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b1626-eeda-4b3a-bb79-b54bf47f70c1 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:04.440281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1288/2576] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:04.461236 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:04.467378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fbbcf-eca2-474e-8678-58858666c36c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:04.472249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9393c4-c6e2-4b5c-b1b1-68c590181584 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2ef9088a9941ddb4b163f282a1f7d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:04.473156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9393c4-c6e2-4b5c-b1b1-68c590181584 service glance] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.473299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9393c4-c6e2-4b5c-b1b1-68c590181584 service glance] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.473595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9393c4-c6e2-4b5c-b1b1-68c590181584 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.484462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9393c4-c6e2-4b5c-b1b1-68c590181584 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:04.486065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9393c4-c6e2-4b5c-b1b1-68c590181584 service glance] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:04.498023 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1289/2577] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:04.569665 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5eed6-120a-4ea8-abbc-c1fcc465df1c None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.570604 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5eed6-120a-4ea8-abbc-c1fcc465df1c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.570905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5eed6-120a-4ea8-abbc-c1fcc465df1c None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.572460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1289/2578] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 02:41:04.577934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b940-9f9b-496a-a120-6195f9b1888e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.578219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b940-9f9b-496a-a120-6195f9b1888e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.578492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b940-9f9b-496a-a120-6195f9b1888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.597704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1ff9b940-9f9b-496a-a120-6195f9b1888e None None] MFA Rules not processed for user `d110c27fc9c045ea9a4eb49b4dafe221`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:04.599542 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1ff9b940-9f9b-496a-a120-6195f9b1888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.608547 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1290/2579] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:04.623441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5eed6-120a-4ea8-abbc-c1fcc465df1c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:04.634536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5eed6-120a-4ea8-abbc-c1fcc465df1c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:04.638351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba90ee-5a88-468d-be8f-e7a01636e8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:04.638970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba90ee-5a88-468d-be8f-e7a01636e8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.639248 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba90ee-5a88-468d-be8f-e7a01636e8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.639604 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba90ee-5a88-468d-be8f-e7a01636e8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.647406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba90ee-5a88-468d-be8f-e7a01636e8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:04.648845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba90ee-5a88-468d-be8f-e7a01636e8f3 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:04.656888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1290/2580] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:04.735688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b940-9f9b-496a-a120-6195f9b1888e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:04.737525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1ff9b940-9f9b-496a-a120-6195f9b1888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.739952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa5ee-3d43-4ffa-bbd7-4f93222ef588 None None] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.740233 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa5ee-3d43-4ffa-bbd7-4f93222ef588 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.740498 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa5ee-3d43-4ffa-bbd7-4f93222ef588 None None] PATH_INFO: `/` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.742414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1291/2581] 10.222.0.69 () {54 vars in 921 bytes} [Thu Aug 4 02:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 02:41:04.748380 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce19fe-72a8-4c67-8d4b-955321b25314 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.748549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce19fe-72a8-4c67-8d4b-955321b25314 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.748820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce19fe-72a8-4c67-8d4b-955321b25314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.755121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b940-9f9b-496a-a120-6195f9b1888e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:04.760455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:04.761096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.761394 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.762181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] PATH_INFO: `/v3/projects/bf4503eca8f14ceb988dfad9c8efddf0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.763373 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4503eca8f14ceb988dfad9c8efddf0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:04.765643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:04.775254 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8bce19fe-72a8-4c67-8d4b-955321b25314 None None] MFA Rules not processed for user `b0096da9bf564ceca61af67cac713f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:04.776449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8bce19fe-72a8-4c67-8d4b-955321b25314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.785782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1292/2582] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Aug 4 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:04.797232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce19fe-72a8-4c67-8d4b-955321b25314 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:04.809632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce19fe-72a8-4c67-8d4b-955321b25314 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:04.815612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4503eca8f14ceb988dfad9c8efddf0', 'request_id': 'req-5cf30e76-652d-48f4-92e2-0f77faf35aaa'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.824414 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4503eca8f14ceb988dfad9c8efddf0', 'request_id': 'req-5cf30e76-652d-48f4-92e2-0f77faf35aaa'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.830509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4503eca8f14ceb988dfad9c8efddf0', 'request_id': 'req-5cf30e76-652d-48f4-92e2-0f77faf35aaa'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.841525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] The token cache is being invalidate because project bf4503eca8f14ceb988dfad9c8efddf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:04.841814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.842485 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5cf30e76-652d-48f4-92e2-0f77faf35aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:04.844426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1291/2583] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:04 2022] DELETE /identity/v3/projects/bf4503eca8f14ceb988dfad9c8efddf0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:04.849346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2efff-111d-428e-8299-25209b1c8a7c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.849632 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2efff-111d-428e-8299-25209b1c8a7c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.849906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2efff-111d-428e-8299-25209b1c8a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.863484 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e5347-f343-4a50-8189-ba9aa15e899c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:04.864095 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e5347-f343-4a50-8189-ba9aa15e899c service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.864369 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e5347-f343-4a50-8189-ba9aa15e899c service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.864644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e5347-f343-4a50-8189-ba9aa15e899c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.866462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-564e5347-f343-4a50-8189-ba9aa15e899c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.870348 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5fd2efff-111d-428e-8299-25209b1c8a7c None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:04.871661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5fd2efff-111d-428e-8299-25209b1c8a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.880730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:04.934206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1292/2584] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:04.939854 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e5347-f343-4a50-8189-ba9aa15e899c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:04.941608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e5347-f343-4a50-8189-ba9aa15e899c service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:04.942779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066c7e2-b7a9-47b0-a395-a29a9e1b8e6a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.943068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066c7e2-b7a9-47b0-a395-a29a9e1b8e6a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.943345 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066c7e2-b7a9-47b0-a395-a29a9e1b8e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.952874 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1293/2585] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:04.963575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9066c7e2-b7a9-47b0-a395-a29a9e1b8e6a None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:04.964785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9066c7e2-b7a9-47b0-a395-a29a9e1b8e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:04.972753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1293/2586] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:04.977503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e5347-f343-4a50-8189-ba9aa15e899c service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:04.987917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e5347-f343-4a50-8189-ba9aa15e899c service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:04.993602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:04.994243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:04.994522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:04.994794 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:04.995485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:04.995786 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:04.997378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.009563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1294/2587] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:41:05.013648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066c7e2-b7a9-47b0-a395-a29a9e1b8e6a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.021692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.023944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:05.025295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066c7e2-b7a9-47b0-a395-a29a9e1b8e6a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.029833 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943627f-d52e-4af2-8ae7-f3948693a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.030441 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943627f-d52e-4af2-8ae7-f3948693a7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.030717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943627f-d52e-4af2-8ae7-f3948693a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.030980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943627f-d52e-4af2-8ae7-f3948693a7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.031668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943627f-d52e-4af2-8ae7-f3948693a7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.033559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943627f-d52e-4af2-8ae7-f3948693a7d3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.061369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1294/2588] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:05 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:05.065404 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943627f-d52e-4af2-8ae7-f3948693a7d3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.095938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802e48b-8699-4bb1-a49e-be9325347373 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.107173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:05.130743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943627f-d52e-4af2-8ae7-f3948693a7d3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.135512 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91361d4-5edb-45d9-9829-8502c9030dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.136127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91361d4-5edb-45d9-9829-8502c9030dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.136410 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91361d4-5edb-45d9-9829-8502c9030dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.136686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91361d4-5edb-45d9-9829-8502c9030dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.137540 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91361d4-5edb-45d9-9829-8502c9030dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.139455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91361d4-5edb-45d9-9829-8502c9030dc1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.156414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be13d5f-cf84-404e-b5fd-bea6e9c8eb96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.157176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be13d5f-cf84-404e-b5fd-bea6e9c8eb96 service placement] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.157495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be13d5f-cf84-404e-b5fd-bea6e9c8eb96 service placement] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.157769 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be13d5f-cf84-404e-b5fd-bea6e9c8eb96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.159548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1be13d5f-cf84-404e-b5fd-bea6e9c8eb96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:05.164984 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1295/2589] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:05 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:05.165943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91361d4-5edb-45d9-9829-8502c9030dc1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.174953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be13d5f-cf84-404e-b5fd-bea6e9c8eb96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.175681 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91361d4-5edb-45d9-9829-8502c9030dc1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.176536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be13d5f-cf84-404e-b5fd-bea6e9c8eb96 service placement] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.180328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b876fc-ade3-4648-ad23-a6fa051102f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.180907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b876fc-ade3-4648-ad23-a6fa051102f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.181211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b876fc-ade3-4648-ad23-a6fa051102f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.181517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b876fc-ade3-4648-ad23-a6fa051102f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.182189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b876fc-ade3-4648-ad23-a6fa051102f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.183848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b876fc-ade3-4648-ad23-a6fa051102f6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.186548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1295/2590] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:05.197358 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1296/2591] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:41:05.198620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be13d5f-cf84-404e-b5fd-bea6e9c8eb96 service placement] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.208746 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be13d5f-cf84-404e-b5fd-bea6e9c8eb96 service placement] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.214126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb018d5d-7279-4ae6-b4b1-2eadeb095dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.214725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb018d5d-7279-4ae6-b4b1-2eadeb095dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.215050 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb018d5d-7279-4ae6-b4b1-2eadeb095dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.215323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb018d5d-7279-4ae6-b4b1-2eadeb095dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.216010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb018d5d-7279-4ae6-b4b1-2eadeb095dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.217641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb018d5d-7279-4ae6-b4b1-2eadeb095dfe admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.228190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1296/2592] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:05.232212 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b876fc-ade3-4648-ad23-a6fa051102f6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.242233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b876fc-ade3-4648-ad23-a6fa051102f6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.246908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69760-6316-409d-980e-3067fd951e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.247814 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69760-6316-409d-980e-3067fd951e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.248104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69760-6316-409d-980e-3067fd951e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.248379 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c69760-6316-409d-980e-3067fd951e7a admin admin] PATH_INFO: `/v3/projects/79940ce6b3fc4f0c82a1acc6e8304253/users/646182d533dd4581bb17ea49d0191411/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.265457 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c69760-6316-409d-980e-3067fd951e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79940ce6b3fc4f0c82a1acc6e8304253, user_id=646182d533dd4581bb17ea49d0191411, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.271621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c69760-6316-409d-980e-3067fd951e7a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.287867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1297/2593] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:05 2022] PUT /identity/v3/projects/79940ce6b3fc4f0c82a1acc6e8304253/users/646182d533dd4581bb17ea49d0191411/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:41:05.299359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec4b26-6a26-440a-959a-58ed5c61080f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.299647 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec4b26-6a26-440a-959a-58ed5c61080f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.299922 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec4b26-6a26-440a-959a-58ed5c61080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.320870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=100 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:05.330464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-aeec4b26-6a26-440a-959a-58ed5c61080f None None] MFA Rules not processed for user `646182d533dd4581bb17ea49d0191411`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:05.332192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-aeec4b26-6a26-440a-959a-58ed5c61080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:05.414640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1297/2594] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:05.418973 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69760-6316-409d-980e-3067fd951e7a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.490422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c69760-6316-409d-980e-3067fd951e7a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.495668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741edf-d055-4331-96f1-e43b2724816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.496273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741edf-d055-4331-96f1-e43b2724816b admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.496550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741edf-d055-4331-96f1-e43b2724816b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.496822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741edf-d055-4331-96f1-e43b2724816b admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.497528 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2741edf-d055-4331-96f1-e43b2724816b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.499919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2741edf-d055-4331-96f1-e43b2724816b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.541268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1298/2595] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:05 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:05.545504 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec4b26-6a26-440a-959a-58ed5c61080f None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.567697 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec4b26-6a26-440a-959a-58ed5c61080f None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.639296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874420dc-5e6c-4fd8-9d5a-6d358a12dd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.640167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874420dc-5e6c-4fd8-9d5a-6d358a12dd21 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.640540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874420dc-5e6c-4fd8-9d5a-6d358a12dd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.640909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874420dc-5e6c-4fd8-9d5a-6d358a12dd21 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.641792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874420dc-5e6c-4fd8-9d5a-6d358a12dd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.644056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874420dc-5e6c-4fd8-9d5a-6d358a12dd21 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.668168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1298/2596] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:05 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:05.672140 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741edf-d055-4331-96f1-e43b2724816b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.683263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2741edf-d055-4331-96f1-e43b2724816b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.687904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e662-b7a4-4edf-a58f-7ceb26fd58f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.688511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e662-b7a4-4edf-a58f-7ceb26fd58f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.688793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e662-b7a4-4edf-a58f-7ceb26fd58f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.689068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e662-b7a4-4edf-a58f-7ceb26fd58f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.689793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e662-b7a4-4edf-a58f-7ceb26fd58f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.691531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e662-b7a4-4edf-a58f-7ceb26fd58f3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.702695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1299/2597] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:05.706781 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874420dc-5e6c-4fd8-9d5a-6d358a12dd21 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.716754 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874420dc-5e6c-4fd8-9d5a-6d358a12dd21 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.721472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f976cac-debc-4722-9d7d-eb755e4b9b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.722002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f976cac-debc-4722-9d7d-eb755e4b9b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.722331 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f976cac-debc-4722-9d7d-eb755e4b9b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.722630 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f976cac-debc-4722-9d7d-eb755e4b9b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.723627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f976cac-debc-4722-9d7d-eb755e4b9b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.725703 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f976cac-debc-4722-9d7d-eb755e4b9b3c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.737734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1299/2598] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:05.742328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e662-b7a4-4edf-a58f-7ceb26fd58f3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.752655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e662-b7a4-4edf-a58f-7ceb26fd58f3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.757907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec43b-5c17-4e63-b384-a1cbdad7c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.758570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec43b-5c17-4e63-b384-a1cbdad7c96b admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.758845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec43b-5c17-4e63-b384-a1cbdad7c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.759116 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ec43b-5c17-4e63-b384-a1cbdad7c96b admin admin] PATH_INFO: `/v3/projects/d841ab44e02c4cba96cae87a51ab2b69/users/69e857ed6c10427ba80b531bde9170de/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.775584 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ec43b-5c17-4e63-b384-a1cbdad7c96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d841ab44e02c4cba96cae87a51ab2b69, user_id=69e857ed6c10427ba80b531bde9170de, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.778491 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ec43b-5c17-4e63-b384-a1cbdad7c96b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.791672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1300/2599] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:05 2022] PUT /identity/v3/projects/d841ab44e02c4cba96cae87a51ab2b69/users/69e857ed6c10427ba80b531bde9170de/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:05.801751 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6f84-a78a-4f1e-8f43-afd151f352c8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.802035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6f84-a78a-4f1e-8f43-afd151f352c8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.802307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6f84-a78a-4f1e-8f43-afd151f352c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.829015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-0eed6f84-a78a-4f1e-8f43-afd151f352c8 None None] MFA Rules not processed for user `69e857ed6c10427ba80b531bde9170de`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:05.830242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0eed6f84-a78a-4f1e-8f43-afd151f352c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:05.893897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1300/2600] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:05.898793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec43b-5c17-4e63-b384-a1cbdad7c96b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:05.943321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:05.961127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ec43b-5c17-4e63-b384-a1cbdad7c96b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:05.965701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93567c9-c939-49ac-882b-a2407f1e8d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:05.966303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93567c9-c939-49ac-882b-a2407f1e8d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:05.966578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93567c9-c939-49ac-882b-a2407f1e8d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:05.966846 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93567c9-c939-49ac-882b-a2407f1e8d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:05.967603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93567c9-c939-49ac-882b-a2407f1e8d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:05.969841 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93567c9-c939-49ac-882b-a2407f1e8d63 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:05.995789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1301/2601] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:05 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:06.000186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed6f84-a78a-4f1e-8f43-afd151f352c8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:06.011187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed6f84-a78a-4f1e-8f43-afd151f352c8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:06.014771 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:06.072445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e58c2-1544-4f74-85d5-55be723a26e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:06.073063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e58c2-1544-4f74-85d5-55be723a26e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:06.073366 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e58c2-1544-4f74-85d5-55be723a26e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:06.073637 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e58c2-1544-4f74-85d5-55be723a26e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:06.074338 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e58c2-1544-4f74-85d5-55be723a26e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:06.076228 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e58c2-1544-4f74-85d5-55be723a26e1 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:06.097917 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1301/2602] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:05 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:06.102099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93567c9-c939-49ac-882b-a2407f1e8d63 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:06.112643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93567c9-c939-49ac-882b-a2407f1e8d63 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:06.117377 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782909c-c546-4773-b493-9ed7b0d57c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:06.118003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782909c-c546-4773-b493-9ed7b0d57c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:06.118285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782909c-c546-4773-b493-9ed7b0d57c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:06.118561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782909c-c546-4773-b493-9ed7b0d57c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:06.119253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782909c-c546-4773-b493-9ed7b0d57c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:06.120842 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782909c-c546-4773-b493-9ed7b0d57c59 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:06.131948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1302/2603] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:06.136553 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e58c2-1544-4f74-85d5-55be723a26e1 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:06.146964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e58c2-1544-4f74-85d5-55be723a26e1 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:06.152147 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a00b51-9a93-4de4-8b94-3dcd3d264b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:06.152810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a00b51-9a93-4de4-8b94-3dcd3d264b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:06.153089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a00b51-9a93-4de4-8b94-3dcd3d264b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:06.153390 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a00b51-9a93-4de4-8b94-3dcd3d264b2f admin admin] PATH_INFO: `/v3/projects/2f80536c87574bc686de323766ed0d3f/users/d896587f730c4533a47a48d5efc60dac/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:06.168600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a00b51-9a93-4de4-8b94-3dcd3d264b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f80536c87574bc686de323766ed0d3f, user_id=d896587f730c4533a47a48d5efc60dac, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:06.171329 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a00b51-9a93-4de4-8b94-3dcd3d264b2f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:06.184237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1302/2604] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:06 2022] PUT /identity/v3/projects/2f80536c87574bc686de323766ed0d3f/users/d896587f730c4533a47a48d5efc60dac/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:06.188307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782909c-c546-4773-b493-9ed7b0d57c59 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:06.199040 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782909c-c546-4773-b493-9ed7b0d57c59 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:06.256387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca257684-4550-4f5b-8bc8-af48c79336f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:06.256999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca257684-4550-4f5b-8bc8-af48c79336f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:06.257797 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca257684-4550-4f5b-8bc8-af48c79336f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:06.258071 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca257684-4550-4f5b-8bc8-af48c79336f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:06.258754 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca257684-4550-4f5b-8bc8-af48c79336f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:06.260337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca257684-4550-4f5b-8bc8-af48c79336f5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:06.270199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1303/2605] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:06.275145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a00b51-9a93-4de4-8b94-3dcd3d264b2f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:06.285515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a00b51-9a93-4de4-8b94-3dcd3d264b2f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:06.290447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1f1eb-faa3-43b5-b3cc-51c0786728d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:06.291112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1f1eb-faa3-43b5-b3cc-51c0786728d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:06.291394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1f1eb-faa3-43b5-b3cc-51c0786728d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:06.291673 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1f1eb-faa3-43b5-b3cc-51c0786728d3 admin admin] PATH_INFO: `/v3/projects/2f80536c87574bc686de323766ed0d3f/users/d896587f730c4533a47a48d5efc60dac/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:06.293652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1f1eb-faa3-43b5-b3cc-51c0786728d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f80536c87574bc686de323766ed0d3f, user_id=d896587f730c4533a47a48d5efc60dac, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:06.296306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1f1eb-faa3-43b5-b3cc-51c0786728d3 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:06.306734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1303/2606] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:06 2022] PUT /identity/v3/projects/2f80536c87574bc686de323766ed0d3f/users/d896587f730c4533a47a48d5efc60dac/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:06.317822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f4eea-bc19-4004-89ec-820d0d836a94 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:06.318109 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f4eea-bc19-4004-89ec-820d0d836a94 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:06.318387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f4eea-bc19-4004-89ec-820d0d836a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:06.346759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ba5f4eea-bc19-4004-89ec-820d0d836a94 None None] MFA Rules not processed for user `d896587f730c4533a47a48d5efc60dac`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:06.347960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ba5f4eea-bc19-4004-89ec-820d0d836a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:06.419104 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1304/2607] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:06.430319 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1f1eb-faa3-43b5-b3cc-51c0786728d3 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:06.431988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-93a1f1eb-faa3-43b5-b3cc-51c0786728d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:06.493232 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1f1eb-faa3-43b5-b3cc-51c0786728d3 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:06.496961 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37129233-a527-40af-b4e1-5836ce4f74ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:06.497868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37129233-a527-40af-b4e1-5836ce4f74ce service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:06.498146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37129233-a527-40af-b4e1-5836ce4f74ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:06.498420 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37129233-a527-40af-b4e1-5836ce4f74ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:06.572402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37129233-a527-40af-b4e1-5836ce4f74ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:06.574019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37129233-a527-40af-b4e1-5836ce4f74ce service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:06.583796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1304/2608] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:06.786849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5053f-3263-426f-8917-066246762754 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:06.787296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5053f-3263-426f-8917-066246762754 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:06.788326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5053f-3263-426f-8917-066246762754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:06.813168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-58c5053f-3263-426f-8917-066246762754 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:06.815339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-58c5053f-3263-426f-8917-066246762754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:06.882492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:06.910714 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1305/2609] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:41:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:06.923004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37129233-a527-40af-b4e1-5836ce4f74ce service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:06.924610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-37129233-a527-40af-b4e1-5836ce4f74ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:06.940669 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:07.000007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37129233-a527-40af-b4e1-5836ce4f74ce service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:07.005087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a261bb-93f0-4bd6-8f03-1c21b641cb75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:07.005737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a261bb-93f0-4bd6-8f03-1c21b641cb75 service swift] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:07.006017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a261bb-93f0-4bd6-8f03-1c21b641cb75 service swift] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:07.006295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a261bb-93f0-4bd6-8f03-1c21b641cb75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:07.014488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a261bb-93f0-4bd6-8f03-1c21b641cb75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:07.016050 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a261bb-93f0-4bd6-8f03-1c21b641cb75 service swift] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:07.024028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1305/2610] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:41:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:41:08.194569 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5053f-3263-426f-8917-066246762754 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:08.196177 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-58c5053f-3263-426f-8917-066246762754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:08.208613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5053f-3263-426f-8917-066246762754 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:08.216145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e554-478a-4943-b71c-d887c773b0a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:08.216785 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e554-478a-4943-b71c-d887c773b0a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:08.217059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e554-478a-4943-b71c-d887c773b0a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:08.217360 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e554-478a-4943-b71c-d887c773b0a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:08.278661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5e554-478a-4943-b71c-d887c773b0a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:08.280161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5e554-478a-4943-b71c-d887c773b0a1 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:08.290629 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1306/2611] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:08.871440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a261bb-93f0-4bd6-8f03-1c21b641cb75 service swift] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:08.881738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a261bb-93f0-4bd6-8f03-1c21b641cb75 service swift] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:08.885441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cced75-9789-447f-9078-ce89f0b37793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:08.886055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cced75-9789-447f-9078-ce89f0b37793 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:08.886335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cced75-9789-447f-9078-ce89f0b37793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:08.886610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cced75-9789-447f-9078-ce89f0b37793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:08.896377 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cced75-9789-447f-9078-ce89f0b37793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:08.898379 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cced75-9789-447f-9078-ce89f0b37793 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:08.909166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1306/2612] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:12.945287 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e554-478a-4943-b71c-d887c773b0a1 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:13.012085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e554-478a-4943-b71c-d887c773b0a1 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:13.017603 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:13.018268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:13.018545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:13.018816 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] PATH_INFO: `/v3/users/646182d533dd4581bb17ea49d0191411` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:13.020093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] RBAC: Authorizing `identity:delete_user(user_id=646182d533dd4581bb17ea49d0191411)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:13.022059 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:13.077130 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646182d533dd4581bb17ea49d0191411'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.086572 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646182d533dd4581bb17ea49d0191411'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.095380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646182d533dd4581bb17ea49d0191411'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.096230 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646182d533dd4581bb17ea49d0191411'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.096871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646182d533dd4581bb17ea49d0191411'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.111965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:13.117490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1307/2613] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:12 2022] DELETE /identity/v3/users/646182d533dd4581bb17ea49d0191411 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:13.121740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ac92e-3bca-474b-8bd4-e0b79f59fac8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:13.122528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ac92e-3bca-474b-8bd4-e0b79f59fac8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:13.122528 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ac92e-3bca-474b-8bd4-e0b79f59fac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:13.145014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-0c9ac92e-3bca-474b-8bd4-e0b79f59fac8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:13.146207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0c9ac92e-3bca-474b-8bd4-e0b79f59fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:13.234896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1307/2614] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:13.244370 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:13.245929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:13.309474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e852d15-7039-4c82-a247-3f532281b56a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:13.313211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6a5a7-25bd-4b99-81f7-62a9cbd6af9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:13.313864 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6a5a7-25bd-4b99-81f7-62a9cbd6af9c service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:13.314163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6a5a7-25bd-4b99-81f7-62a9cbd6af9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:13.314452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6a5a7-25bd-4b99-81f7-62a9cbd6af9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:13.324017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6a5a7-25bd-4b99-81f7-62a9cbd6af9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:13.325475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6a5a7-25bd-4b99-81f7-62a9cbd6af9c service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:13.337196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1308/2615] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:13.662460 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ac92e-3bca-474b-8bd4-e0b79f59fac8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:13.663912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0c9ac92e-3bca-474b-8bd4-e0b79f59fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:13.677100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ac92e-3bca-474b-8bd4-e0b79f59fac8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:13.682394 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:13.683041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:13.683159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:13.683595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] PATH_INFO: `/v3/projects/79940ce6b3fc4f0c82a1acc6e8304253` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:13.690004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79940ce6b3fc4f0c82a1acc6e8304253)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:13.691971 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:13.747170 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79940ce6b3fc4f0c82a1acc6e8304253', 'request_id': 'req-ab79642d-4a50-448e-be36-697156f0c533'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.759059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79940ce6b3fc4f0c82a1acc6e8304253', 'request_id': 'req-ab79642d-4a50-448e-be36-697156f0c533'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.768747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79940ce6b3fc4f0c82a1acc6e8304253', 'request_id': 'req-ab79642d-4a50-448e-be36-697156f0c533'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.782772 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] The token cache is being invalidate because project 79940ce6b3fc4f0c82a1acc6e8304253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:13.783400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.784277 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.789113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1308/2616] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:13 2022] DELETE /identity/v3/projects/79940ce6b3fc4f0c82a1acc6e8304253 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:13.790188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6a5a7-25bd-4b99-81f7-62a9cbd6af9c service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:13.801838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6a5a7-25bd-4b99-81f7-62a9cbd6af9c service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:13.870193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:13.871088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:13.871443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:13.871792 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] PATH_INFO: `/v3/users/69e857ed6c10427ba80b531bde9170de` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:13.873687 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e857ed6c10427ba80b531bde9170de)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:13.879046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:13.940021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e857ed6c10427ba80b531bde9170de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.957896 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e857ed6c10427ba80b531bde9170de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.966858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e857ed6c10427ba80b531bde9170de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.967623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e857ed6c10427ba80b531bde9170de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.968301 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e857ed6c10427ba80b531bde9170de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:13.989262 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1309/2617] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:13 2022] DELETE /identity/v3/users/69e857ed6c10427ba80b531bde9170de => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:41:14.373210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:14.374942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:14.401133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79642d-4a50-448e-be36-697156f0c533 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:14.430650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:14.505234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:14.506066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.506441 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.506809 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] PATH_INFO: `/v3/projects/d841ab44e02c4cba96cae87a51ab2b69` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.510925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d841ab44e02c4cba96cae87a51ab2b69)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:14.513316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:14.582517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd841ab44e02c4cba96cae87a51ab2b69', 'request_id': 'req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.591692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd841ab44e02c4cba96cae87a51ab2b69', 'request_id': 'req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.598360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd841ab44e02c4cba96cae87a51ab2b69', 'request_id': 'req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.618547 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] The token cache is being invalidate because project d841ab44e02c4cba96cae87a51ab2b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:14.618834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.619497 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.621030 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1309/2618] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:14 2022] DELETE /identity/v3/projects/d841ab44e02c4cba96cae87a51ab2b69 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:14.625552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:14.627052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:14.641093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1008a-b988-4bdb-9a78-0ca8887dbdd1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:14.665451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:14.715205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:14.716014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:14.716369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:14.716707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] PATH_INFO: `/v3/users/d896587f730c4533a47a48d5efc60dac` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:14.718336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d896587f730c4533a47a48d5efc60dac)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:14.720437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:14.772380 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd896587f730c4533a47a48d5efc60dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.781931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd896587f730c4533a47a48d5efc60dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.790942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd896587f730c4533a47a48d5efc60dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.791641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd896587f730c4533a47a48d5efc60dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.792279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-62df4f73-4018-438b-b9c8-f67291a2fc96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd896587f730c4533a47a48d5efc60dac'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:14.810669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1310/2619] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:14 2022] DELETE /identity/v3/users/d896587f730c4533a47a48d5efc60dac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:15.116776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:15.118240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:15.163958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a53d6-8fae-4fd7-beba-ff0a2fc5fdfc admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:15.242641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:15.243734 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.244164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.244670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] PATH_INFO: `/v3/projects/2f80536c87574bc686de323766ed0d3f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.246190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f80536c87574bc686de323766ed0d3f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:15.249311 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:15.300835 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:15.304321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f80536c87574bc686de323766ed0d3f', 'request_id': 'req-152fb766-ba50-451c-8e57-e3ed665ff97f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:15.313014 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f80536c87574bc686de323766ed0d3f', 'request_id': 'req-152fb766-ba50-451c-8e57-e3ed665ff97f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:15.319526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f80536c87574bc686de323766ed0d3f', 'request_id': 'req-152fb766-ba50-451c-8e57-e3ed665ff97f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:15.331123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] The token cache is being invalidate because project 2f80536c87574bc686de323766ed0d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:15.331409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:15.332080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-152fb766-ba50-451c-8e57-e3ed665ff97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:15.333641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1310/2620] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:15 2022] DELETE /identity/v3/projects/2f80536c87574bc686de323766ed0d3f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:15.339146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005edf77-bf32-496c-935c-9750efe2d782 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.339741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005edf77-bf32-496c-935c-9750efe2d782 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.339741 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005edf77-bf32-496c-935c-9750efe2d782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.360448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-005edf77-bf32-496c-935c-9750efe2d782 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:15.361806 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-005edf77-bf32-496c-935c-9750efe2d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:15.429942 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1311/2621] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:15.437799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69cddc-dde7-4808-82f8-e8547d021ffe None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.438337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69cddc-dde7-4808-82f8-e8547d021ffe None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.438337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69cddc-dde7-4808-82f8-e8547d021ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.463477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-7d69cddc-dde7-4808-82f8-e8547d021ffe None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:15.465297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7d69cddc-dde7-4808-82f8-e8547d021ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:15.483078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005edf77-bf32-496c-935c-9750efe2d782 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:15.483600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1311/2622] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:15.496266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005edf77-bf32-496c-935c-9750efe2d782 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:15.501143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e1217-47de-428b-aabb-7dac7eb60c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:15.501879 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e1217-47de-428b-aabb-7dac7eb60c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.502157 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e1217-47de-428b-aabb-7dac7eb60c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.502426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e1217-47de-428b-aabb-7dac7eb60c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.503117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e1217-47de-428b-aabb-7dac7eb60c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:15.503416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e1217-47de-428b-aabb-7dac7eb60c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:15.505110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e1217-47de-428b-aabb-7dac7eb60c87 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:15.519666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1312/2623] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:15.525264 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69cddc-dde7-4808-82f8-e8547d021ffe None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:15.535831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69cddc-dde7-4808-82f8-e8547d021ffe None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:15.544479 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fc482-a5a5-4612-909f-b399bd6422f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:15.545114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc482-a5a5-4612-909f-b399bd6422f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.545429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc482-a5a5-4612-909f-b399bd6422f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.545704 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc482-a5a5-4612-909f-b399bd6422f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.546399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fc482-a5a5-4612-909f-b399bd6422f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:15.548322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fc482-a5a5-4612-909f-b399bd6422f5 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:15.596467 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1312/2624] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:15 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:15.597994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e1217-47de-428b-aabb-7dac7eb60c87 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:15.608470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e1217-47de-428b-aabb-7dac7eb60c87 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:15.647173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:15.688889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94e208-6d07-41c3-b888-10f5987804ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:15.689582 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94e208-6d07-41c3-b888-10f5987804ea admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.689936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94e208-6d07-41c3-b888-10f5987804ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.690308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94e208-6d07-41c3-b888-10f5987804ea admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.691047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94e208-6d07-41c3-b888-10f5987804ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:15.693110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94e208-6d07-41c3-b888-10f5987804ea admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:15.718698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1313/2625] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:15 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:15.723260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fc482-a5a5-4612-909f-b399bd6422f5 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:15.733730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fc482-a5a5-4612-909f-b399bd6422f5 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:15.738470 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103000f-7993-4337-a10c-fbfae3a1ae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:15.739156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103000f-7993-4337-a10c-fbfae3a1ae14 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.739438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103000f-7993-4337-a10c-fbfae3a1ae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.739710 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103000f-7993-4337-a10c-fbfae3a1ae14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.740401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103000f-7993-4337-a10c-fbfae3a1ae14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:15.742523 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103000f-7993-4337-a10c-fbfae3a1ae14 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:15.753795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1313/2626] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:15.758219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94e208-6d07-41c3-b888-10f5987804ea admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:15.769168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94e208-6d07-41c3-b888-10f5987804ea admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:15.773848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82828c36-e84a-49ae-a7aa-51af28f25c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:15.774580 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82828c36-e84a-49ae-a7aa-51af28f25c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.774921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82828c36-e84a-49ae-a7aa-51af28f25c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.775199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82828c36-e84a-49ae-a7aa-51af28f25c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.775991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82828c36-e84a-49ae-a7aa-51af28f25c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:15.777974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82828c36-e84a-49ae-a7aa-51af28f25c9c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:15.789249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1314/2627] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:41:15.793512 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103000f-7993-4337-a10c-fbfae3a1ae14 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:15.803800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103000f-7993-4337-a10c-fbfae3a1ae14 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:15.809076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b348d-5541-4d3c-8c50-f066fe79ad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:15.809778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b348d-5541-4d3c-8c50-f066fe79ad26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.810063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b348d-5541-4d3c-8c50-f066fe79ad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.810339 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b348d-5541-4d3c-8c50-f066fe79ad26 admin admin] PATH_INFO: `/v3/projects/d0aa2907c560412dad9d1fefb02c0596/users/3d7b839887cb4edba263c580aa8f6e6e/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.825816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b348d-5541-4d3c-8c50-f066fe79ad26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0aa2907c560412dad9d1fefb02c0596, user_id=3d7b839887cb4edba263c580aa8f6e6e, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:15.828453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b348d-5541-4d3c-8c50-f066fe79ad26 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:15.843368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1314/2628] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:15 2022] PUT /identity/v3/projects/d0aa2907c560412dad9d1fefb02c0596/users/3d7b839887cb4edba263c580aa8f6e6e/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:15.910594 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4a82-6930-4f1e-ae2d-7b86f862f3b4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:15.910980 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4a82-6930-4f1e-ae2d-7b86f862f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:15.911331 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c4a82-6930-4f1e-ae2d-7b86f862f3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:15.940778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bc0c4a82-6930-4f1e-ae2d-7b86f862f3b4 None None] MFA Rules not processed for user `3d7b839887cb4edba263c580aa8f6e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:15.941939 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bc0c4a82-6930-4f1e-ae2d-7b86f862f3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:16.006775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1315/2629] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:16.017446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b348d-5541-4d3c-8c50-f066fe79ad26 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:16.019167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-0f4b348d-5541-4d3c-8c50-f066fe79ad26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:16.077066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b348d-5541-4d3c-8c50-f066fe79ad26 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:16.080657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52623cd-a00d-4b73-a72e-14aa661d56e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:16.081263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52623cd-a00d-4b73-a72e-14aa661d56e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:16.081638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52623cd-a00d-4b73-a72e-14aa661d56e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:16.081909 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52623cd-a00d-4b73-a72e-14aa661d56e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:16.090144 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52623cd-a00d-4b73-a72e-14aa661d56e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:16.091551 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52623cd-a00d-4b73-a72e-14aa661d56e4 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:16.100320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1315/2630] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:16.503031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4a82-6930-4f1e-ae2d-7b86f862f3b4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:16.504768 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bc0c4a82-6930-4f1e-ae2d-7b86f862f3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:16.562186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c4a82-6930-4f1e-ae2d-7b86f862f3b4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:16.565829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:16.566444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:16.566723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:16.567000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:16.568797 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:16.579196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:16.580835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:16.590316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1316/2631] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:21.750231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d350-a2b5-47ae-bb5b-686fd70dc8ba None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:21.750780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d350-a2b5-47ae-bb5b-686fd70dc8ba None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:21.750889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518d350-a2b5-47ae-bb5b-686fd70dc8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:21.773689 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-c518d350-a2b5-47ae-bb5b-686fd70dc8ba None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:21.774880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-c518d350-a2b5-47ae-bb5b-686fd70dc8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:21.850403 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1316/2632] 10.222.0.69 () {58 vars in 967 bytes} [Thu Aug 4 02:41:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:21.864940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:21.867309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:21.914506 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:21.944344 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1580d2d-62e6-4827-bb3e-9a1df6c521ab service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:21.949321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99f831-964c-446c-b0a6-835284ad7c66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:21.949959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f831-964c-446c-b0a6-835284ad7c66 service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:21.950239 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f831-964c-446c-b0a6-835284ad7c66 service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:21.952782 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f831-964c-446c-b0a6-835284ad7c66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:21.962610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99f831-964c-446c-b0a6-835284ad7c66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:21.964195 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99f831-964c-446c-b0a6-835284ad7c66 service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:21.973099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1317/2633] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:41:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:41:26.257515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d350-a2b5-47ae-bb5b-686fd70dc8ba None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:26.276548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:26.343259 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518d350-a2b5-47ae-bb5b-686fd70dc8ba None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:26.348168 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:26.348763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:26.349072 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:26.349368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] PATH_INFO: `/v3/users/3d7b839887cb4edba263c580aa8f6e6e` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:26.350555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7b839887cb4edba263c580aa8f6e6e)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:26.352662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:26.404632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7b839887cb4edba263c580aa8f6e6e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.411659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7b839887cb4edba263c580aa8f6e6e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.418712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7b839887cb4edba263c580aa8f6e6e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.419326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7b839887cb4edba263c580aa8f6e6e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.431163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7b839887cb4edba263c580aa8f6e6e'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.437266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1317/2634] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:26 2022] DELETE /identity/v3/users/3d7b839887cb4edba263c580aa8f6e6e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:26.441678 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8338-8cd0-4da2-aeea-f0f887532067 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:26.442147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8338-8cd0-4da2-aeea-f0f887532067 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:26.442244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a8338-8cd0-4da2-aeea-f0f887532067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:26.460938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f37a8338-8cd0-4da2-aeea-f0f887532067 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:26.462716 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f37a8338-8cd0-4da2-aeea-f0f887532067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:26.521353 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1318/2635] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:26.531505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:26.532898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:26.591623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e40a4d-e6b3-435a-aa30-1b9554108ac4 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:26.595409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d1a00-4c3d-4da6-8724-98a3ef9c1729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:26.596112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1a00-4c3d-4da6-8724-98a3ef9c1729 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:26.596398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1a00-4c3d-4da6-8724-98a3ef9c1729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:26.596675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1a00-4c3d-4da6-8724-98a3ef9c1729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:26.606084 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d1a00-4c3d-4da6-8724-98a3ef9c1729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:26.607501 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d1a00-4c3d-4da6-8724-98a3ef9c1729 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:26.617128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1318/2636] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:26.897392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8338-8cd0-4da2-aeea-f0f887532067 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:26.900361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f37a8338-8cd0-4da2-aeea-f0f887532067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:26.916876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a8338-8cd0-4da2-aeea-f0f887532067 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:26.922958 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:26.923660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:26.923893 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:26.924812 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] PATH_INFO: `/v3/projects/d0aa2907c560412dad9d1fefb02c0596` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:26.926019 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0aa2907c560412dad9d1fefb02c0596)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:26.928007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:26.977975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0aa2907c560412dad9d1fefb02c0596', 'request_id': 'req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.986222 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0aa2907c560412dad9d1fefb02c0596', 'request_id': 'req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:26.993801 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0aa2907c560412dad9d1fefb02c0596', 'request_id': 'req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:27.005588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] The token cache is being invalidate because project d0aa2907c560412dad9d1fefb02c0596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:27.005875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:27.006532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:27.008054 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1319/2637] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:26 2022] DELETE /identity/v3/projects/d0aa2907c560412dad9d1fefb02c0596 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:28.361230 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d1a00-4c3d-4da6-8724-98a3ef9c1729 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:28.363022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-1c5d1a00-4c3d-4da6-8724-98a3ef9c1729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:28.462335 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:28.504299 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d1a00-4c3d-4da6-8724-98a3ef9c1729 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:28.574409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:28.575032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:28.575312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:28.575583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:28.577386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:28.589423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:28.590984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:28.601298 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1319/2638] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:33.963117 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:33.964670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:33.985758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd38ea-8bb5-45d0-91a6-47c5fe8f7957 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:33.991509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd502a29-d5fb-461b-8ed8-90ca623496a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:33.992175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502a29-d5fb-461b-8ed8-90ca623496a1 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:33.992448 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502a29-d5fb-461b-8ed8-90ca623496a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:33.992807 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd502a29-d5fb-461b-8ed8-90ca623496a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:33.994784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fd502a29-d5fb-461b-8ed8-90ca623496a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:34.008863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd502a29-d5fb-461b-8ed8-90ca623496a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:34.010589 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd502a29-d5fb-461b-8ed8-90ca623496a1 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:34.022733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1320/2639] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:38.596986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=44 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:41.971318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:41.972736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:42.042846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84324cd-1576-4cfb-b1cf-2683d8909bf8 service nova] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:42.047256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:42.047879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.048153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.048422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] PATH_INFO: `/v3/users/bb8f655ed67d46a5b4211a851f8da02d` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.049577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8f655ed67d46a5b4211a851f8da02d)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:42.051480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:42.100171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8f655ed67d46a5b4211a851f8da02d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.107190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8f655ed67d46a5b4211a851f8da02d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.114267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8f655ed67d46a5b4211a851f8da02d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.114914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8f655ed67d46a5b4211a851f8da02d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.126731 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-e44cc396-d265-4f9d-9e8c-adba800c9638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8f655ed67d46a5b4211a851f8da02d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.133062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1320/2640] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:41 2022] DELETE /identity/v3/users/bb8f655ed67d46a5b4211a851f8da02d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:42.316565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd502a29-d5fb-461b-8ed8-90ca623496a1 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:42.333273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd502a29-d5fb-461b-8ed8-90ca623496a1 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:42.375147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:42.396211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:42.396859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.397142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.397449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] PATH_INFO: `/v3/projects/c76d1fe69b2e4c5dbb1493fce4c8b2ca` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.399351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76d1fe69b2e4c5dbb1493fce4c8b2ca)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:42.401266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:42.448444 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76d1fe69b2e4c5dbb1493fce4c8b2ca', 'request_id': 'req-5483a2bc-c1db-47f4-8d2a-c803af9ee393'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.455422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76d1fe69b2e4c5dbb1493fce4c8b2ca', 'request_id': 'req-5483a2bc-c1db-47f4-8d2a-c803af9ee393'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.460907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76d1fe69b2e4c5dbb1493fce4c8b2ca', 'request_id': 'req-5483a2bc-c1db-47f4-8d2a-c803af9ee393'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.472037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] The token cache is being invalidate because project c76d1fe69b2e4c5dbb1493fce4c8b2ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:42.472319 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.472938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5483a2bc-c1db-47f4-8d2a-c803af9ee393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:42.474460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1321/2641] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:42 2022] DELETE /identity/v3/projects/c76d1fe69b2e4c5dbb1493fce4c8b2ca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:42.479321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cd493-d5b5-49fe-b475-a24ee64e9301 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.479603 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cd493-d5b5-49fe-b475-a24ee64e9301 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.479873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cd493-d5b5-49fe-b475-a24ee64e9301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.499278 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-297cd493-d5b5-49fe-b475-a24ee64e9301 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:42.500455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-297cd493-d5b5-49fe-b475-a24ee64e9301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:42.559672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1321/2642] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:42.567396 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef338823-537f-423e-8337-76015d8d4c69 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.567708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef338823-537f-423e-8337-76015d8d4c69 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.567988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef338823-537f-423e-8337-76015d8d4c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.588701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ef338823-537f-423e-8337-76015d8d4c69 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:42.589923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ef338823-537f-423e-8337-76015d8d4c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:42.597819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1322/2643] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:42.602712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cd493-d5b5-49fe-b475-a24ee64e9301 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:42.612429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cd493-d5b5-49fe-b475-a24ee64e9301 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:42.617123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bee3be-94c1-4e83-b011-a8ed67ddd6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:42.617757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bee3be-94c1-4e83-b011-a8ed67ddd6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.618036 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bee3be-94c1-4e83-b011-a8ed67ddd6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.618306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bee3be-94c1-4e83-b011-a8ed67ddd6fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.618990 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bee3be-94c1-4e83-b011-a8ed67ddd6fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:42.619290 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bee3be-94c1-4e83-b011-a8ed67ddd6fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:42.620846 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bee3be-94c1-4e83-b011-a8ed67ddd6fe admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:42.632641 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1322/2644] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 02:41:42.636793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef338823-537f-423e-8337-76015d8d4c69 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:42.646389 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef338823-537f-423e-8337-76015d8d4c69 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:42.652161 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd1b83-fb5a-4499-84ee-8bcaa791cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:42.652774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd1b83-fb5a-4499-84ee-8bcaa791cb25 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.653035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd1b83-fb5a-4499-84ee-8bcaa791cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.653303 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd1b83-fb5a-4499-84ee-8bcaa791cb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.653990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd1b83-fb5a-4499-84ee-8bcaa791cb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:42.655922 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd1b83-fb5a-4499-84ee-8bcaa791cb25 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:42.683724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1323/2645] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:42 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:42.687965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bee3be-94c1-4e83-b011-a8ed67ddd6fe admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:42.698738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bee3be-94c1-4e83-b011-a8ed67ddd6fe admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:42.702427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:42.764067 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a9155-8275-46db-b80d-9a0984c8bf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:42.764680 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a9155-8275-46db-b80d-9a0984c8bf61 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.764984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a9155-8275-46db-b80d-9a0984c8bf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.765256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a9155-8275-46db-b80d-9a0984c8bf61 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.765958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a9155-8275-46db-b80d-9a0984c8bf61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:42.767929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a9155-8275-46db-b80d-9a0984c8bf61 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:42.789912 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1323/2646] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:42 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:42.794032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd1b83-fb5a-4499-84ee-8bcaa791cb25 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:42.804403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd1b83-fb5a-4499-84ee-8bcaa791cb25 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:42.809198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fd7b1-57d4-4a97-a8de-83eda536723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:42.809882 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fd7b1-57d4-4a97-a8de-83eda536723b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.810119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fd7b1-57d4-4a97-a8de-83eda536723b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.810395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fd7b1-57d4-4a97-a8de-83eda536723b admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.811081 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fd7b1-57d4-4a97-a8de-83eda536723b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:42.812667 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fd7b1-57d4-4a97-a8de-83eda536723b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:42.823598 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1324/2647] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:42.827622 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a9155-8275-46db-b80d-9a0984c8bf61 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:42.838058 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a9155-8275-46db-b80d-9a0984c8bf61 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:42.842580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657130a-a65c-43f0-80e6-47d1d98ef255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:42.843169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657130a-a65c-43f0-80e6-47d1d98ef255 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.843446 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657130a-a65c-43f0-80e6-47d1d98ef255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.843716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657130a-a65c-43f0-80e6-47d1d98ef255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.844386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657130a-a65c-43f0-80e6-47d1d98ef255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:42.845985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657130a-a65c-43f0-80e6-47d1d98ef255 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:42.856384 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1324/2648] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:42.860381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fd7b1-57d4-4a97-a8de-83eda536723b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:42.870343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fd7b1-57d4-4a97-a8de-83eda536723b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:42.875172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08b386-71af-49ec-964f-80a29da106dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:42.875810 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08b386-71af-49ec-964f-80a29da106dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.876083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08b386-71af-49ec-964f-80a29da106dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.876350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08b386-71af-49ec-964f-80a29da106dc admin admin] PATH_INFO: `/v3/projects/0b1131b3f1ee4b60b8c20ee78c66c117/users/7e6e2737126a47acb40cfa180a7d8944/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.890994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08b386-71af-49ec-964f-80a29da106dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1131b3f1ee4b60b8c20ee78c66c117, user_id=7e6e2737126a47acb40cfa180a7d8944, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:42.893648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08b386-71af-49ec-964f-80a29da106dc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:42.907139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1325/2649] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:42 2022] PUT /identity/v3/projects/0b1131b3f1ee4b60b8c20ee78c66c117/users/7e6e2737126a47acb40cfa180a7d8944/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:42.917876 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52191ba-1fdb-4a1c-9c02-e957ac2a3e80 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:42.918156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52191ba-1fdb-4a1c-9c02-e957ac2a3e80 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:42.918427 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52191ba-1fdb-4a1c-9c02-e957ac2a3e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:42.945455 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f52191ba-1fdb-4a1c-9c02-e957ac2a3e80 None None] MFA Rules not processed for user `7e6e2737126a47acb40cfa180a7d8944`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:42.946640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f52191ba-1fdb-4a1c-9c02-e957ac2a3e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:43.008533 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1325/2650] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:43.019439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08b386-71af-49ec-964f-80a29da106dc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:43.021072 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cc08b386-71af-49ec-964f-80a29da106dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:43.089307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:43.094135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08b386-71af-49ec-964f-80a29da106dc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:43.100848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569719a-c9ec-4eca-822a-2086c6cb60e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:43.101488 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569719a-c9ec-4eca-822a-2086c6cb60e1 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:43.101815 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569719a-c9ec-4eca-822a-2086c6cb60e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:43.102239 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569719a-c9ec-4eca-822a-2086c6cb60e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:43.109972 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569719a-c9ec-4eca-822a-2086c6cb60e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:43.111537 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569719a-c9ec-4eca-822a-2086c6cb60e1 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:43.120172 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1326/2651] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:48.274192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52191ba-1fdb-4a1c-9c02-e957ac2a3e80 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:48.332873 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52191ba-1fdb-4a1c-9c02-e957ac2a3e80 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:48.338225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:48.338863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.339167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.339447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] PATH_INFO: `/v3/users/7e6e2737126a47acb40cfa180a7d8944` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.340608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6e2737126a47acb40cfa180a7d8944)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:48.342609 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:48.358060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:48.388740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6e2737126a47acb40cfa180a7d8944'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.395918 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6e2737126a47acb40cfa180a7d8944'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.403803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6e2737126a47acb40cfa180a7d8944'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.404393 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6e2737126a47acb40cfa180a7d8944'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.416755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6e2737126a47acb40cfa180a7d8944'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.422517 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1326/2652] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:48 2022] DELETE /identity/v3/users/7e6e2737126a47acb40cfa180a7d8944 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:48.426947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521f41-7e7f-4eba-8df8-384b7be30047 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.427443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521f41-7e7f-4eba-8df8-384b7be30047 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.427549 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521f41-7e7f-4eba-8df8-384b7be30047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.447092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-64521f41-7e7f-4eba-8df8-384b7be30047 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:48.448280 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-64521f41-7e7f-4eba-8df8-384b7be30047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:48.505694 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1327/2653] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:48.515934 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:48.517307 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:48.576046 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0abf68-a891-462f-9de7-5e67557cef2d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:48.579552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaeb053-19e2-4437-bdd5-d8f50576fe31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:48.580158 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaeb053-19e2-4437-bdd5-d8f50576fe31 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.580438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaeb053-19e2-4437-bdd5-d8f50576fe31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.580712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaeb053-19e2-4437-bdd5-d8f50576fe31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.589805 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaeb053-19e2-4437-bdd5-d8f50576fe31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:48.591217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaeb053-19e2-4437-bdd5-d8f50576fe31 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:48.600569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1327/2654] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:41:48.870295 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64521f41-7e7f-4eba-8df8-384b7be30047 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:48.871964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-64521f41-7e7f-4eba-8df8-384b7be30047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:48.883666 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64521f41-7e7f-4eba-8df8-384b7be30047 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:48.888324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:48.888960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.889237 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.889565 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] PATH_INFO: `/v3/projects/0b1131b3f1ee4b60b8c20ee78c66c117` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.890749 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1131b3f1ee4b60b8c20ee78c66c117)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:48.892648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:48.939151 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1131b3f1ee4b60b8c20ee78c66c117', 'request_id': 'req-4a16afe7-5fae-4174-836c-4f73da824792'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.946229 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1131b3f1ee4b60b8c20ee78c66c117', 'request_id': 'req-4a16afe7-5fae-4174-836c-4f73da824792'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.951784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1131b3f1ee4b60b8c20ee78c66c117', 'request_id': 'req-4a16afe7-5fae-4174-836c-4f73da824792'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.962403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] The token cache is being invalidate because project 0b1131b3f1ee4b60b8c20ee78c66c117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:48.962682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.963294 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4a16afe7-5fae-4174-836c-4f73da824792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:48.964969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1328/2655] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:48 2022] DELETE /identity/v3/projects/0b1131b3f1ee4b60b8c20ee78c66c117 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:48.969714 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bae80-aca3-4acf-a96d-f9e2f53446de None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:48.969997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bae80-aca3-4acf-a96d-f9e2f53446de None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:48.970271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bae80-aca3-4acf-a96d-f9e2f53446de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:48.989969 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-212bae80-aca3-4acf-a96d-f9e2f53446de None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:48.991160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-212bae80-aca3-4acf-a96d-f9e2f53446de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:49.051004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1328/2656] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:49.059497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee116-ad42-4ea1-80f0-551340d18dff None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.059781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee116-ad42-4ea1-80f0-551340d18dff None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.060055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee116-ad42-4ea1-80f0-551340d18dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.079031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-584ee116-ad42-4ea1-80f0-551340d18dff None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:49.080213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-584ee116-ad42-4ea1-80f0-551340d18dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:49.087940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1329/2657] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:49.091970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bae80-aca3-4acf-a96d-f9e2f53446de None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.102002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bae80-aca3-4acf-a96d-f9e2f53446de None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.106560 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cf919-d9e6-4b59-bc02-c0423ff6e193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.107149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cf919-d9e6-4b59-bc02-c0423ff6e193 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.107428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cf919-d9e6-4b59-bc02-c0423ff6e193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.107695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cf919-d9e6-4b59-bc02-c0423ff6e193 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.108372 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cf919-d9e6-4b59-bc02-c0423ff6e193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:49.108670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cf919-d9e6-4b59-bc02-c0423ff6e193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.110285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cf919-d9e6-4b59-bc02-c0423ff6e193 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.122780 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1329/2658] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:49.126853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee116-ad42-4ea1-80f0-551340d18dff None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.135921 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee116-ad42-4ea1-80f0-551340d18dff None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.140505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e61ab-46f3-47f1-b4c0-0599329a81be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.141096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e61ab-46f3-47f1-b4c0-0599329a81be admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.141405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e61ab-46f3-47f1-b4c0-0599329a81be admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.141680 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e61ab-46f3-47f1-b4c0-0599329a81be admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.142327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e61ab-46f3-47f1-b4c0-0599329a81be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.144200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e61ab-46f3-47f1-b4c0-0599329a81be admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.171167 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1330/2659] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:49.175142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cf919-d9e6-4b59-bc02-c0423ff6e193 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.185494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cf919-d9e6-4b59-bc02-c0423ff6e193 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.205126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:49.243035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676add0a-414c-47e5-ba26-abd6a8d552c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.243638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676add0a-414c-47e5-ba26-abd6a8d552c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.243915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676add0a-414c-47e5-ba26-abd6a8d552c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.244189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676add0a-414c-47e5-ba26-abd6a8d552c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.244827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676add0a-414c-47e5-ba26-abd6a8d552c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.247007 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676add0a-414c-47e5-ba26-abd6a8d552c8 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.267401 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1330/2660] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:49.271631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e61ab-46f3-47f1-b4c0-0599329a81be admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.282269 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e61ab-46f3-47f1-b4c0-0599329a81be admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.286985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655315e6-aa37-432a-96d7-dc998c0dcafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.287607 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655315e6-aa37-432a-96d7-dc998c0dcafd admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.287881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655315e6-aa37-432a-96d7-dc998c0dcafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.288150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655315e6-aa37-432a-96d7-dc998c0dcafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.289431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655315e6-aa37-432a-96d7-dc998c0dcafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.291018 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655315e6-aa37-432a-96d7-dc998c0dcafd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.300854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1331/2661] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:49.304661 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676add0a-414c-47e5-ba26-abd6a8d552c8 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.315025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676add0a-414c-47e5-ba26-abd6a8d552c8 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.319871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518befce-fec6-4324-b988-8ce8fd639f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.320487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518befce-fec6-4324-b988-8ce8fd639f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.320762 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518befce-fec6-4324-b988-8ce8fd639f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.321027 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518befce-fec6-4324-b988-8ce8fd639f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.321747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518befce-fec6-4324-b988-8ce8fd639f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.323360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518befce-fec6-4324-b988-8ce8fd639f44 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.333923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1331/2662] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:49.338378 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655315e6-aa37-432a-96d7-dc998c0dcafd admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.348779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655315e6-aa37-432a-96d7-dc998c0dcafd admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.354031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f4065-1090-481b-b6bc-0366ea732c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.354672 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f4065-1090-481b-b6bc-0366ea732c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.354949 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f4065-1090-481b-b6bc-0366ea732c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.355219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f4065-1090-481b-b6bc-0366ea732c13 admin admin] PATH_INFO: `/v3/projects/7f7fc764feb2474c87a4f036e7c1ff18/users/f4a08f7267724f1c86dd96d826020340/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.369466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f4065-1090-481b-b6bc-0366ea732c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7fc764feb2474c87a4f036e7c1ff18, user_id=f4a08f7267724f1c86dd96d826020340, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.372363 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f4065-1090-481b-b6bc-0366ea732c13 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.384971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1332/2663] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:49 2022] PUT /identity/v3/projects/7f7fc764feb2474c87a4f036e7c1ff18/users/f4a08f7267724f1c86dd96d826020340/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:49.394908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15971-4314-4e96-8e65-294e4204caa5 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.395193 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15971-4314-4e96-8e65-294e4204caa5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.395469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15971-4314-4e96-8e65-294e4204caa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.423211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3ec15971-4314-4e96-8e65-294e4204caa5 None None] MFA Rules not processed for user `f4a08f7267724f1c86dd96d826020340`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:49.424333 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3ec15971-4314-4e96-8e65-294e4204caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:49.487245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1332/2664] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:49.491767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f4065-1090-481b-b6bc-0366ea732c13 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.504329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:49.558401 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f4065-1090-481b-b6bc-0366ea732c13 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.563141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7337b-0a5a-4c8d-a9fb-e231047cd971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.563750 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7337b-0a5a-4c8d-a9fb-e231047cd971 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.564032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7337b-0a5a-4c8d-a9fb-e231047cd971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.564335 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7337b-0a5a-4c8d-a9fb-e231047cd971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.565003 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7337b-0a5a-4c8d-a9fb-e231047cd971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.566932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7337b-0a5a-4c8d-a9fb-e231047cd971 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.594297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1333/2665] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:49.598405 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec15971-4314-4e96-8e65-294e4204caa5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.609059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec15971-4314-4e96-8e65-294e4204caa5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.663952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3708b-68f7-4370-8707-2a039483ec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.664558 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3708b-68f7-4370-8707-2a039483ec5d admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.664832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3708b-68f7-4370-8707-2a039483ec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.665101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3708b-68f7-4370-8707-2a039483ec5d admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.665783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3708b-68f7-4370-8707-2a039483ec5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.667707 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3708b-68f7-4370-8707-2a039483ec5d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.688351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1333/2666] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:41:49.692515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7337b-0a5a-4c8d-a9fb-e231047cd971 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.703199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7337b-0a5a-4c8d-a9fb-e231047cd971 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.708047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6949bd4-cbd9-4f72-aa20-e8f5f43ec3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.708658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6949bd4-cbd9-4f72-aa20-e8f5f43ec3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.708940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6949bd4-cbd9-4f72-aa20-e8f5f43ec3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.709239 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6949bd4-cbd9-4f72-aa20-e8f5f43ec3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.709964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6949bd4-cbd9-4f72-aa20-e8f5f43ec3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.712228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6949bd4-cbd9-4f72-aa20-e8f5f43ec3c2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.722913 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1334/2667] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:49.726964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3708b-68f7-4370-8707-2a039483ec5d admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.736878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3708b-68f7-4370-8707-2a039483ec5d admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.741438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996639b-ac95-4674-ade6-427768ba78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.742081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996639b-ac95-4674-ade6-427768ba78b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.742355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996639b-ac95-4674-ade6-427768ba78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.742624 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996639b-ac95-4674-ade6-427768ba78b9 admin admin] PATH_INFO: `/v3/projects/ad5ec35bad96436d806cb4aec2e24685/users/18ac8549f2bc48149e22953a2d8a32a3/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.756838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996639b-ac95-4674-ade6-427768ba78b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5ec35bad96436d806cb4aec2e24685, user_id=18ac8549f2bc48149e22953a2d8a32a3, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.759953 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996639b-ac95-4674-ade6-427768ba78b9 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.767763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:49.774549 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1334/2668] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:49 2022] PUT /identity/v3/projects/ad5ec35bad96436d806cb4aec2e24685/users/18ac8549f2bc48149e22953a2d8a32a3/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:41:49.778627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6949bd4-cbd9-4f72-aa20-e8f5f43ec3c2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.788415 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6949bd4-cbd9-4f72-aa20-e8f5f43ec3c2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.844639 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f6f16-6db8-4991-b4d6-8488d752c0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.845243 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f6f16-6db8-4991-b4d6-8488d752c0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.845550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f6f16-6db8-4991-b4d6-8488d752c0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.845823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f6f16-6db8-4991-b4d6-8488d752c0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.846500 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f6f16-6db8-4991-b4d6-8488d752c0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.848083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f6f16-6db8-4991-b4d6-8488d752c0b0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.857599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1335/2669] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:49.861729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996639b-ac95-4674-ade6-427768ba78b9 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:49.871998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996639b-ac95-4674-ade6-427768ba78b9 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:49.876784 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8af9e9-f676-4d53-b83e-abe6ec1d9f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:49.877550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8af9e9-f676-4d53-b83e-abe6ec1d9f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.877831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8af9e9-f676-4d53-b83e-abe6ec1d9f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.878104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8af9e9-f676-4d53-b83e-abe6ec1d9f89 admin admin] PATH_INFO: `/v3/projects/ad5ec35bad96436d806cb4aec2e24685/users/18ac8549f2bc48149e22953a2d8a32a3/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.880054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8af9e9-f676-4d53-b83e-abe6ec1d9f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5ec35bad96436d806cb4aec2e24685, user_id=18ac8549f2bc48149e22953a2d8a32a3, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:49.883288 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8af9e9-f676-4d53-b83e-abe6ec1d9f89 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:49.893443 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1335/2670] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:49 2022] PUT /identity/v3/projects/ad5ec35bad96436d806cb4aec2e24685/users/18ac8549f2bc48149e22953a2d8a32a3/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:41:49.905270 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae6bca-1d37-41d5-b431-f65bebc06d83 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:49.905581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae6bca-1d37-41d5-b431-f65bebc06d83 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:49.905865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae6bca-1d37-41d5-b431-f65bebc06d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:49.933490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-90ae6bca-1d37-41d5-b431-f65bebc06d83 None None] MFA Rules not processed for user `18ac8549f2bc48149e22953a2d8a32a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:49.934688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-90ae6bca-1d37-41d5-b431-f65bebc06d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:50.001665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1336/2671] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:50.013414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8af9e9-f676-4d53-b83e-abe6ec1d9f89 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.015066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4c8af9e9-f676-4d53-b83e-abe6ec1d9f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:50.071163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8af9e9-f676-4d53-b83e-abe6ec1d9f89 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.074832 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439d1b2-6745-41c9-865f-61f4ff7b21a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.075437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d1b2-6745-41c9-865f-61f4ff7b21a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.075715 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d1b2-6745-41c9-865f-61f4ff7b21a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.075988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439d1b2-6745-41c9-865f-61f4ff7b21a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.084930 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439d1b2-6745-41c9-865f-61f4ff7b21a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.086363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439d1b2-6745-41c9-865f-61f4ff7b21a0 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.095598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1336/2672] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:50.160561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae6bca-1d37-41d5-b431-f65bebc06d83 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.169221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:50.223961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae6bca-1d37-41d5-b431-f65bebc06d83 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.228460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.229091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.229398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.229824 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] PATH_INFO: `/v3/users/f4a08f7267724f1c86dd96d826020340` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.230991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a08f7267724f1c86dd96d826020340)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.232897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.278386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a08f7267724f1c86dd96d826020340'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.285250 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a08f7267724f1c86dd96d826020340'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.292136 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a08f7267724f1c86dd96d826020340'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.292800 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a08f7267724f1c86dd96d826020340'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.293509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a08f7267724f1c86dd96d826020340'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.310875 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1337/2673] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:50 2022] DELETE /identity/v3/users/f4a08f7267724f1c86dd96d826020340 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:50.315538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f6ab2-846b-4474-9a01-1e582bb7a6bd None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.316017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f6ab2-846b-4474-9a01-1e582bb7a6bd None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.316133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f6ab2-846b-4474-9a01-1e582bb7a6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.335253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-b55f6ab2-846b-4474-9a01-1e582bb7a6bd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:50.336472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b55f6ab2-846b-4474-9a01-1e582bb7a6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:50.394580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1337/2674] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:50.404251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.405761 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:50.461936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e73ec4-3d98-4f72-8cfb-b62eac9d421b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.465552 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cce7c-3062-4e7c-8bce-27af875c128e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.466166 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cce7c-3062-4e7c-8bce-27af875c128e service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.466440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cce7c-3062-4e7c-8bce-27af875c128e service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.466708 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cce7c-3062-4e7c-8bce-27af875c128e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.476595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cce7c-3062-4e7c-8bce-27af875c128e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.478181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cce7c-3062-4e7c-8bce-27af875c128e service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.487771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1338/2675] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:50.752944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f6ab2-846b-4474-9a01-1e582bb7a6bd None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.754436 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b55f6ab2-846b-4474-9a01-1e582bb7a6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:50.776208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f6ab2-846b-4474-9a01-1e582bb7a6bd None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.780837 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.781538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.781816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.782088 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] PATH_INFO: `/v3/projects/7f7fc764feb2474c87a4f036e7c1ff18` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.783229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7fc764feb2474c87a4f036e7c1ff18)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.785141 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.831509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7fc764feb2474c87a4f036e7c1ff18', 'request_id': 'req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.838759 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7fc764feb2474c87a4f036e7c1ff18', 'request_id': 'req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.844188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7fc764feb2474c87a4f036e7c1ff18', 'request_id': 'req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.855481 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] The token cache is being invalidate because project 7f7fc764feb2474c87a4f036e7c1ff18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:50.855773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.856429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.857945 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1338/2676] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:50 2022] DELETE /identity/v3/projects/7f7fc764feb2474c87a4f036e7c1ff18 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:50.861990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cce7c-3062-4e7c-8bce-27af875c128e service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:50.872031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cce7c-3062-4e7c-8bce-27af875c128e service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:50.897315 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:50.929044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:50.929722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:50.930007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:50.930281 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] PATH_INFO: `/v3/users/18ac8549f2bc48149e22953a2d8a32a3` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:50.931431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ac8549f2bc48149e22953a2d8a32a3)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:50.933383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:50.978347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ac8549f2bc48149e22953a2d8a32a3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.985674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ac8549f2bc48149e22953a2d8a32a3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.992781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ac8549f2bc48149e22953a2d8a32a3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.993501 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ac8549f2bc48149e22953a2d8a32a3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:50.994103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cd34f079-9a72-4ce0-963f-d7d9e0e22ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ac8549f2bc48149e22953a2d8a32a3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:51.012808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1339/2677] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:41:50 2022] DELETE /identity/v3/users/18ac8549f2bc48149e22953a2d8a32a3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:51.279887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:51.281296 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:51.295775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0ff9e-fc1e-4279-98f5-274b3ed4a0dd admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:51.305048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:51.357352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:51.358031 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.358247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.358567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] PATH_INFO: `/v3/projects/ad5ec35bad96436d806cb4aec2e24685` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.359667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5ec35bad96436d806cb4aec2e24685)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:51.361610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:51.413048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5ec35bad96436d806cb4aec2e24685', 'request_id': 'req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:51.422138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5ec35bad96436d806cb4aec2e24685', 'request_id': 'req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:51.429246 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5ec35bad96436d806cb4aec2e24685', 'request_id': 'req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:51.441464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] The token cache is being invalidate because project ad5ec35bad96436d806cb4aec2e24685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:41:51.441830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:51.442445 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d7d95c9f-44a2-45df-9e35-3d4a6fb637bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:41:51.444004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1339/2678] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:41:51 2022] DELETE /identity/v3/projects/ad5ec35bad96436d806cb4aec2e24685 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:51.449901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcd61e-4ac5-47e3-9eca-fa2147b75478 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.450224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcd61e-4ac5-47e3-9eca-fa2147b75478 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.450527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcd61e-4ac5-47e3-9eca-fa2147b75478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.470431 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6fbcd61e-4ac5-47e3-9eca-fa2147b75478 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:51.471671 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6fbcd61e-4ac5-47e3-9eca-fa2147b75478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:51.531309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1340/2679] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:51.539448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93087c-7e48-4224-89eb-a43f29629217 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.539739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93087c-7e48-4224-89eb-a43f29629217 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.540016 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93087c-7e48-4224-89eb-a43f29629217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.560263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ca93087c-7e48-4224-89eb-a43f29629217 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:51.561511 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ca93087c-7e48-4224-89eb-a43f29629217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:51.570023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1340/2680] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:41:51.574326 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcd61e-4ac5-47e3-9eca-fa2147b75478 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:51.584011 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcd61e-4ac5-47e3-9eca-fa2147b75478 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:51.588520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51dd2a-4b39-440b-b2e5-cb46e1767bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:51.589123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51dd2a-4b39-440b-b2e5-cb46e1767bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.589427 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51dd2a-4b39-440b-b2e5-cb46e1767bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.589703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51dd2a-4b39-440b-b2e5-cb46e1767bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.590417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51dd2a-4b39-440b-b2e5-cb46e1767bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:41:51.590834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51dd2a-4b39-440b-b2e5-cb46e1767bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:51.592440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51dd2a-4b39-440b-b2e5-cb46e1767bfd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:51.603964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1341/2681] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:41:51.608241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93087c-7e48-4224-89eb-a43f29629217 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:51.618175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93087c-7e48-4224-89eb-a43f29629217 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:51.622984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b1675-52fa-41bf-b0c3-a7f8bf3b0184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:51.623576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b1675-52fa-41bf-b0c3-a7f8bf3b0184 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.623851 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b1675-52fa-41bf-b0c3-a7f8bf3b0184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.624119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b1675-52fa-41bf-b0c3-a7f8bf3b0184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.624764 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b1675-52fa-41bf-b0c3-a7f8bf3b0184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:51.626657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b1675-52fa-41bf-b0c3-a7f8bf3b0184 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:51.653825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1341/2682] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:51 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:51.658123 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51dd2a-4b39-440b-b2e5-cb46e1767bfd admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:51.667969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51dd2a-4b39-440b-b2e5-cb46e1767bfd admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:51.700188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:51.725845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d993c-de75-4a45-a025-d90bae283e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:51.726446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d993c-de75-4a45-a025-d90bae283e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.726726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d993c-de75-4a45-a025-d90bae283e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.726997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d993c-de75-4a45-a025-d90bae283e91 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.727645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d993c-de75-4a45-a025-d90bae283e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:51.729588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d993c-de75-4a45-a025-d90bae283e91 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:51.750894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1342/2683] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:51 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:51.755076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b1675-52fa-41bf-b0c3-a7f8bf3b0184 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:51.765869 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b1675-52fa-41bf-b0c3-a7f8bf3b0184 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:51.770488 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba98847-b1b5-4196-9286-9d833bfec006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:51.771092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba98847-b1b5-4196-9286-9d833bfec006 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.771368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba98847-b1b5-4196-9286-9d833bfec006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.771639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba98847-b1b5-4196-9286-9d833bfec006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.772322 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba98847-b1b5-4196-9286-9d833bfec006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:51.773962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba98847-b1b5-4196-9286-9d833bfec006 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:51.783749 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1342/2684] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:51.787595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d993c-de75-4a45-a025-d90bae283e91 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:51.797446 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d993c-de75-4a45-a025-d90bae283e91 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:51.801968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2caff-c935-4056-b153-8e2175bda69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:51.802557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2caff-c935-4056-b153-8e2175bda69d admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.802840 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2caff-c935-4056-b153-8e2175bda69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.803110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2caff-c935-4056-b153-8e2175bda69d admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.804286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2caff-c935-4056-b153-8e2175bda69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:51.805899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2caff-c935-4056-b153-8e2175bda69d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:51.815642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1343/2685] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:51.820073 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba98847-b1b5-4196-9286-9d833bfec006 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:51.829960 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba98847-b1b5-4196-9286-9d833bfec006 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:51.834755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe7125-54a8-4ec0-8a31-25073642aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:51.835408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe7125-54a8-4ec0-8a31-25073642aec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.835692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe7125-54a8-4ec0-8a31-25073642aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.835995 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe7125-54a8-4ec0-8a31-25073642aec6 admin admin] PATH_INFO: `/v3/projects/cda99da6c0d94bb29d1341a1c32d2367/users/048648aa49c04ad8b37742968a6e3f3d/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.851103 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe7125-54a8-4ec0-8a31-25073642aec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda99da6c0d94bb29d1341a1c32d2367, user_id=048648aa49c04ad8b37742968a6e3f3d, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:51.853790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe7125-54a8-4ec0-8a31-25073642aec6 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:51.866133 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1343/2686] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:51 2022] PUT /identity/v3/projects/cda99da6c0d94bb29d1341a1c32d2367/users/048648aa49c04ad8b37742968a6e3f3d/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:51.872027 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342376-ecc0-4045-9f7d-a2d574ab15b3 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:51.872495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342376-ecc0-4045-9f7d-a2d574ab15b3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:51.872604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342376-ecc0-4045-9f7d-a2d574ab15b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:51.892450 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d7342376-ecc0-4045-9f7d-a2d574ab15b3 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:51.893696 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d7342376-ecc0-4045-9f7d-a2d574ab15b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:51.952445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1344/2687] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:51.962161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe7125-54a8-4ec0-8a31-25073642aec6 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:51.963836 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-68fe7125-54a8-4ec0-8a31-25073642aec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:52.005956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:52.023071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe7125-54a8-4ec0-8a31-25073642aec6 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:52.026730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44778-bcc4-4cd6-b5ab-861a1fcfa747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:52.027361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44778-bcc4-4cd6-b5ab-861a1fcfa747 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:52.027623 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44778-bcc4-4cd6-b5ab-861a1fcfa747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:52.027898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44778-bcc4-4cd6-b5ab-861a1fcfa747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:52.036878 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f44778-bcc4-4cd6-b5ab-861a1fcfa747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:52.038849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f44778-bcc4-4cd6-b5ab-861a1fcfa747 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:52.048270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1344/2688] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:41:52.660402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b02bf9-ab92-4e95-add5-62a37b616bff None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:52.660691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b02bf9-ab92-4e95-add5-62a37b616bff None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:52.660964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b02bf9-ab92-4e95-add5-62a37b616bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:52.688336 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-95b02bf9-ab92-4e95-add5-62a37b616bff None None] MFA Rules not processed for user `048648aa49c04ad8b37742968a6e3f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:52.689577 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-95b02bf9-ab92-4e95-add5-62a37b616bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:52.758637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1345/2689] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:52.763353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44778-bcc4-4cd6-b5ab-861a1fcfa747 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:52.773696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44778-bcc4-4cd6-b5ab-861a1fcfa747 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:52.778255 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7253-7d82-4279-a928-85707f790957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:52.778862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7253-7d82-4279-a928-85707f790957 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:52.779140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7253-7d82-4279-a928-85707f790957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:52.779411 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7253-7d82-4279-a928-85707f790957 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:52.780076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e7253-7d82-4279-a928-85707f790957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:52.781999 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e7253-7d82-4279-a928-85707f790957 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:52.810093 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1345/2690] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:41:52 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:52.814079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b02bf9-ab92-4e95-add5-62a37b616bff None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:52.826242 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b02bf9-ab92-4e95-add5-62a37b616bff None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:52.868902 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:52.885354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeedf0-a42e-4990-bc90-201e6dc135ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:52.886057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeedf0-a42e-4990-bc90-201e6dc135ff admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:52.886340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeedf0-a42e-4990-bc90-201e6dc135ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:52.886613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeedf0-a42e-4990-bc90-201e6dc135ff admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:52.887268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeedf0-a42e-4990-bc90-201e6dc135ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:52.889178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeedf0-a42e-4990-bc90-201e6dc135ff admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:52.910688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1346/2691] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:41:52 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:41:52.914297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7253-7d82-4279-a928-85707f790957 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:52.924757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7253-7d82-4279-a928-85707f790957 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:52.929988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd9c38-aca2-494e-8564-09331e8b66d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:52.930591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd9c38-aca2-494e-8564-09331e8b66d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:52.930871 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd9c38-aca2-494e-8564-09331e8b66d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:52.931143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd9c38-aca2-494e-8564-09331e8b66d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:52.931824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd9c38-aca2-494e-8564-09331e8b66d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:52.933435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd9c38-aca2-494e-8564-09331e8b66d4 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:52.943952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1346/2692] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:52.948895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeedf0-a42e-4990-bc90-201e6dc135ff admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:52.958959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeedf0-a42e-4990-bc90-201e6dc135ff admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:52.963608 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b927a-cb5c-43f0-ab85-758460f83dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:52.964268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b927a-cb5c-43f0-ab85-758460f83dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:52.964557 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b927a-cb5c-43f0-ab85-758460f83dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:52.964834 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b927a-cb5c-43f0-ab85-758460f83dc5 admin admin] PATH_INFO: `/v3/projects/de8e5c9b87c24da1904f892af1eae230/users/967e8b0c9ac44aaba241ddafe0ebd617/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:52.979490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b927a-cb5c-43f0-ab85-758460f83dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8e5c9b87c24da1904f892af1eae230, user_id=967e8b0c9ac44aaba241ddafe0ebd617, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:52.982196 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b927a-cb5c-43f0-ab85-758460f83dc5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:52.995324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1347/2693] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:52 2022] PUT /identity/v3/projects/de8e5c9b87c24da1904f892af1eae230/users/967e8b0c9ac44aaba241ddafe0ebd617/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:52.999592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd9c38-aca2-494e-8564-09331e8b66d4 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:53.010303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd9c38-aca2-494e-8564-09331e8b66d4 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:53.065515 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe1b4-034e-4e64-adf2-c85a047170bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:53.066048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe1b4-034e-4e64-adf2-c85a047170bd admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:53.066359 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe1b4-034e-4e64-adf2-c85a047170bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:53.066682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe1b4-034e-4e64-adf2-c85a047170bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:53.067365 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe1b4-034e-4e64-adf2-c85a047170bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:53.068962 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe1b4-034e-4e64-adf2-c85a047170bd admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:53.079763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1347/2694] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:41:53.083915 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b927a-cb5c-43f0-ab85-758460f83dc5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:53.094145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b927a-cb5c-43f0-ab85-758460f83dc5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:53.098819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01701016-5cf5-42cd-a290-983faa918d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:53.099478 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701016-5cf5-42cd-a290-983faa918d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:53.099759 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701016-5cf5-42cd-a290-983faa918d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:53.100035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701016-5cf5-42cd-a290-983faa918d1a admin admin] PATH_INFO: `/v3/projects/de8e5c9b87c24da1904f892af1eae230/users/967e8b0c9ac44aaba241ddafe0ebd617/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:53.102020 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01701016-5cf5-42cd-a290-983faa918d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8e5c9b87c24da1904f892af1eae230, user_id=967e8b0c9ac44aaba241ddafe0ebd617, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:53.104628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01701016-5cf5-42cd-a290-983faa918d1a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:53.114753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1348/2695] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:41:53 2022] PUT /identity/v3/projects/de8e5c9b87c24da1904f892af1eae230/users/967e8b0c9ac44aaba241ddafe0ebd617/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:41:53.748861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7543-dae7-45f2-978d-8d870a1d71ca None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:53.749192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7543-dae7-45f2-978d-8d870a1d71ca None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:53.749579 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7543-dae7-45f2-978d-8d870a1d71ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:53.778239 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-331d7543-dae7-45f2-978d-8d870a1d71ca None None] MFA Rules not processed for user `967e8b0c9ac44aaba241ddafe0ebd617`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:53.780113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-331d7543-dae7-45f2-978d-8d870a1d71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:53.850594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1348/2696] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:53.860920 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9dcc-85c2-4ce8-8711-5ba749bc7d9b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:53.861208 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9dcc-85c2-4ce8-8711-5ba749bc7d9b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:53.861513 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a9dcc-85c2-4ce8-8711-5ba749bc7d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:53.885035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d68a9dcc-85c2-4ce8-8711-5ba749bc7d9b None None] MFA Rules not processed for user `048648aa49c04ad8b37742968a6e3f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:41:53.886302 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d68a9dcc-85c2-4ce8-8711-5ba749bc7d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:53.944952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1349/2697] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:41:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:41:53.958439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7543-dae7-45f2-978d-8d870a1d71ca None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:41:53.960465 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-331d7543-dae7-45f2-978d-8d870a1d71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:41:53.991941 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:41:54.035386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7543-dae7-45f2-978d-8d870a1d71ca None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:41:54.041595 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe572a-4456-41d1-8250-cd4fe6c99cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:41:54.042202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe572a-4456-41d1-8250-cd4fe6c99cdc service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:41:54.042480 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe572a-4456-41d1-8250-cd4fe6c99cdc service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:41:54.042753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe572a-4456-41d1-8250-cd4fe6c99cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:41:54.050434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe572a-4456-41d1-8250-cd4fe6c99cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:41:54.051985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe572a-4456-41d1-8250-cd4fe6c99cdc service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:41:54.061300 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1349/2698] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:41:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:03.831822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a9dcc-85c2-4ce8-8711-5ba749bc7d9b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:03.833198 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d68a9dcc-85c2-4ce8-8711-5ba749bc7d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:03.889784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a9dcc-85c2-4ce8-8711-5ba749bc7d9b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:03.893246 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:03.893901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:03.894181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:03.894452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:03.896182 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:03.948082 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:03.961350 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:03.962798 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:03.972430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1350/2699] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:04.057395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=21 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:06.081112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe572a-4456-41d1-8250-cd4fe6c99cdc service nova] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:06.082716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-86fe572a-4456-41d1-8250-cd4fe6c99cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:06.145729 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe572a-4456-41d1-8250-cd4fe6c99cdc service nova] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:06.150076 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73df738-961c-40c4-85e7-cca18c188841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:06.150695 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73df738-961c-40c4-85e7-cca18c188841 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:06.150982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73df738-961c-40c4-85e7-cca18c188841 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:06.151258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73df738-961c-40c4-85e7-cca18c188841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:06.160376 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73df738-961c-40c4-85e7-cca18c188841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:06.161849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73df738-961c-40c4-85e7-cca18c188841 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:06.171400 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1350/2700] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:07.150388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:07.151997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:07.210126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73df738-961c-40c4-85e7-cca18c188841 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:07.211561 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-b73df738-961c-40c4-85e7-cca18c188841 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:07.227906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc973fc5-9b17-4d58-87dc-735830278b7c service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:07.228068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73df738-961c-40c4-85e7-cca18c188841 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:07.233033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771f4d9-e372-4c00-823c-905f44619e08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:07.233931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f4d9-e372-4c00-823c-905f44619e08 service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:07.234469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f4d9-e372-4c00-823c-905f44619e08 service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:07.234742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f4d9-e372-4c00-823c-905f44619e08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:07.236511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e771f4d9-e372-4c00-823c-905f44619e08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:07.237668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:07.238308 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:07.238589 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:07.238864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] PATH_INFO: `/v3/users/a1631559d5194f1fa449a16f93546349` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:07.240048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1631559d5194f1fa449a16f93546349)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:07.242608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:07.252210 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771f4d9-e372-4c00-823c-905f44619e08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:07.254121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771f4d9-e372-4c00-823c-905f44619e08 service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:07.265347 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1351/2701] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:07.292017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1631559d5194f1fa449a16f93546349'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.299649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1631559d5194f1fa449a16f93546349'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.307279 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1631559d5194f1fa449a16f93546349'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.307902 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1631559d5194f1fa449a16f93546349'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.320187 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-af64d2a0-4b48-4ff8-bd29-9648efa5883f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1631559d5194f1fa449a16f93546349'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.326010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1351/2702] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:42:07 2022] DELETE /identity/v3/users/a1631559d5194f1fa449a16f93546349 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:42:07.494341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771f4d9-e372-4c00-823c-905f44619e08 service placement] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:07.505369 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771f4d9-e372-4c00-823c-905f44619e08 service placement] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:07.561233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:07.561899 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:07.562178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:07.562449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] PATH_INFO: `/v3/projects/6f92bcbe02bd4ddead54adba555e3f3d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:07.563590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f92bcbe02bd4ddead54adba555e3f3d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:07.565503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:07.612636 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f92bcbe02bd4ddead54adba555e3f3d', 'request_id': 'req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.620429 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f92bcbe02bd4ddead54adba555e3f3d', 'request_id': 'req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.626278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f92bcbe02bd4ddead54adba555e3f3d', 'request_id': 'req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.637665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] The token cache is being invalidate because project 6f92bcbe02bd4ddead54adba555e3f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:42:07.638142 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.639128 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dfdbf61d-c703-4e45-a0b7-3dd8e2db44ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:07.641838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1352/2703] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:42:07 2022] DELETE /identity/v3/projects/6f92bcbe02bd4ddead54adba555e3f3d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:07.647340 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921504a-6aec-4ca0-b51e-abc1264466ee None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:07.647627 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921504a-6aec-4ca0-b51e-abc1264466ee None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:07.647897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921504a-6aec-4ca0-b51e-abc1264466ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:07.667643 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9921504a-6aec-4ca0-b51e-abc1264466ee None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:07.668834 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9921504a-6aec-4ca0-b51e-abc1264466ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:07.725946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1352/2704] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:07.734843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9179a4-b1e8-4ae9-bf35-040671a7fce8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:07.735124 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9179a4-b1e8-4ae9-bf35-040671a7fce8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:07.735395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9179a4-b1e8-4ae9-bf35-040671a7fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:07.755090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-fb9179a4-b1e8-4ae9-bf35-040671a7fce8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:07.756271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fb9179a4-b1e8-4ae9-bf35-040671a7fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:07.764078 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1353/2705] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:07.768406 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921504a-6aec-4ca0-b51e-abc1264466ee None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:07.778943 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921504a-6aec-4ca0-b51e-abc1264466ee None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:07.783620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d813cef-9799-458f-9ffc-cb6776d12f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:07.784293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d813cef-9799-458f-9ffc-cb6776d12f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:07.784503 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d813cef-9799-458f-9ffc-cb6776d12f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:07.784774 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d813cef-9799-458f-9ffc-cb6776d12f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:07.785556 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d813cef-9799-458f-9ffc-cb6776d12f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:42:07.785816 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d813cef-9799-458f-9ffc-cb6776d12f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:07.788309 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d813cef-9799-458f-9ffc-cb6776d12f4f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:07.799888 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1353/2706] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:42:07.804327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9179a4-b1e8-4ae9-bf35-040671a7fce8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:07.810012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:07.813706 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9179a4-b1e8-4ae9-bf35-040671a7fce8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:07.819308 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490fb87-589b-478d-898b-238ee84aaa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:07.820085 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490fb87-589b-478d-898b-238ee84aaa61 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:07.820590 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490fb87-589b-478d-898b-238ee84aaa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:07.820918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490fb87-589b-478d-898b-238ee84aaa61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:07.821774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490fb87-589b-478d-898b-238ee84aaa61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:07.823752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490fb87-589b-478d-898b-238ee84aaa61 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:07.849665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1354/2707] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:42:07 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:42:07.854428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d813cef-9799-458f-9ffc-cb6776d12f4f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:07.859625 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:07.865857 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d813cef-9799-458f-9ffc-cb6776d12f4f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:07.923408 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabb2c4-c824-4cb4-a13f-f3214c6b4189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:07.924042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabb2c4-c824-4cb4-a13f-f3214c6b4189 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:07.924323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabb2c4-c824-4cb4-a13f-f3214c6b4189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:07.924598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabb2c4-c824-4cb4-a13f-f3214c6b4189 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:07.925265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabb2c4-c824-4cb4-a13f-f3214c6b4189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:07.927205 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabb2c4-c824-4cb4-a13f-f3214c6b4189 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:07.947915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1354/2708] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:42:07 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:42:07.952033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490fb87-589b-478d-898b-238ee84aaa61 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:07.963007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490fb87-589b-478d-898b-238ee84aaa61 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:07.968016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c102bcf-b0f2-4edd-bfe6-43155f7d2aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:07.968619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102bcf-b0f2-4edd-bfe6-43155f7d2aed admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:07.968895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102bcf-b0f2-4edd-bfe6-43155f7d2aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:07.969164 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102bcf-b0f2-4edd-bfe6-43155f7d2aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:07.969883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c102bcf-b0f2-4edd-bfe6-43155f7d2aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:07.971456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c102bcf-b0f2-4edd-bfe6-43155f7d2aed admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:07.981445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1355/2709] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:07.985534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabb2c4-c824-4cb4-a13f-f3214c6b4189 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:07.996417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabb2c4-c824-4cb4-a13f-f3214c6b4189 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:08.001281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1f90f-4c9c-4c5d-b231-f78e42cfe98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:08.001930 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1f90f-4c9c-4c5d-b231-f78e42cfe98f admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:08.002210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1f90f-4c9c-4c5d-b231-f78e42cfe98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:08.002487 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1f90f-4c9c-4c5d-b231-f78e42cfe98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:08.003166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1f90f-4c9c-4c5d-b231-f78e42cfe98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:08.004761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1f90f-4c9c-4c5d-b231-f78e42cfe98f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:08.016730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1355/2710] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:08.020867 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c102bcf-b0f2-4edd-bfe6-43155f7d2aed admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:08.031527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c102bcf-b0f2-4edd-bfe6-43155f7d2aed admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:08.036080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469021a0-37b9-45dd-b4a7-4bfd89bc0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:08.036722 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469021a0-37b9-45dd-b4a7-4bfd89bc0ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:08.037000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469021a0-37b9-45dd-b4a7-4bfd89bc0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:08.037288 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469021a0-37b9-45dd-b4a7-4bfd89bc0ae7 admin admin] PATH_INFO: `/v3/projects/a65007945367413a8389d49a2099f948/users/1160278ef4e347dda8ca86a82535f416/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:08.052127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469021a0-37b9-45dd-b4a7-4bfd89bc0ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65007945367413a8389d49a2099f948, user_id=1160278ef4e347dda8ca86a82535f416, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:08.054897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469021a0-37b9-45dd-b4a7-4bfd89bc0ae7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:08.067127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1356/2711] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:42:08 2022] PUT /identity/v3/projects/a65007945367413a8389d49a2099f948/users/1160278ef4e347dda8ca86a82535f416/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:08.072530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f773-9168-4bc7-804c-7af6b20b8825 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:08.072858 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f773-9168-4bc7-804c-7af6b20b8825 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:08.073135 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f773-9168-4bc7-804c-7af6b20b8825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:08.093294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ac90f773-9168-4bc7-804c-7af6b20b8825 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:08.094635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ac90f773-9168-4bc7-804c-7af6b20b8825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:08.157410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1356/2712] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:42:08.167099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469021a0-37b9-45dd-b4a7-4bfd89bc0ae7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:08.168886 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-469021a0-37b9-45dd-b4a7-4bfd89bc0ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:08.233211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469021a0-37b9-45dd-b4a7-4bfd89bc0ae7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:08.236870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a28b8-d09f-491d-9efc-59522cd0220c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:08.237507 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a28b8-d09f-491d-9efc-59522cd0220c service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:08.237784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a28b8-d09f-491d-9efc-59522cd0220c service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:08.238051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a28b8-d09f-491d-9efc-59522cd0220c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:08.249439 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a28b8-d09f-491d-9efc-59522cd0220c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:08.250865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a28b8-d09f-491d-9efc-59522cd0220c service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:08.260791 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1357/2713] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:12.878151 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935d08b-e6ae-48ac-9cd0-619016ba7542 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:12.878657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935d08b-e6ae-48ac-9cd0-619016ba7542 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:12.878778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935d08b-e6ae-48ac-9cd0-619016ba7542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:12.910535 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2935d08b-e6ae-48ac-9cd0-619016ba7542 None None] MFA Rules not processed for user `1160278ef4e347dda8ca86a82535f416`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:12.911740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2935d08b-e6ae-48ac-9cd0-619016ba7542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:13.001642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1357/2714] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:13.006487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a28b8-d09f-491d-9efc-59522cd0220c service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:13.007938 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-eb1a28b8-d09f-491d-9efc-59522cd0220c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:13.094610 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a28b8-d09f-491d-9efc-59522cd0220c service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:13.101094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd38f9e-1400-492e-856d-17ac41ce7121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:13.101753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38f9e-1400-492e-856d-17ac41ce7121 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:13.102033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38f9e-1400-492e-856d-17ac41ce7121 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:13.102299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38f9e-1400-492e-856d-17ac41ce7121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:13.113884 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd38f9e-1400-492e-856d-17ac41ce7121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:13.115521 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd38f9e-1400-492e-856d-17ac41ce7121 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:13.130328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1358/2715] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:14.455849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151102b-50d7-45dc-b03a-5d842c547c2c None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:14.455849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151102b-50d7-45dc-b03a-5d842c547c2c None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:14.455849 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151102b-50d7-45dc-b03a-5d842c547c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:14.478048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3151102b-50d7-45dc-b03a-5d842c547c2c None None] MFA Rules not processed for user `1160278ef4e347dda8ca86a82535f416`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:14.479274 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3151102b-50d7-45dc-b03a-5d842c547c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:14.498763 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1358/2716] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:23.122516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:24.472065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:26.115986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd38f9e-1400-492e-856d-17ac41ce7121 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:26.117881 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7cd38f9e-1400-492e-856d-17ac41ce7121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:26.140247 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd38f9e-1400-492e-856d-17ac41ce7121 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:26.145888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:26.146568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:26.146844 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:26.147535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] PATH_INFO: `/v3/users/048648aa49c04ad8b37742968a6e3f3d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:26.148268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048648aa49c04ad8b37742968a6e3f3d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:26.150207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:26.204049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048648aa49c04ad8b37742968a6e3f3d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.214553 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048648aa49c04ad8b37742968a6e3f3d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.222227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048648aa49c04ad8b37742968a6e3f3d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.223061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048648aa49c04ad8b37742968a6e3f3d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.223677 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048648aa49c04ad8b37742968a6e3f3d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.242849 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1359/2717] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:42:26 2022] DELETE /identity/v3/users/048648aa49c04ad8b37742968a6e3f3d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:26.432872 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151102b-50d7-45dc-b03a-5d842c547c2c None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:26.447184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151102b-50d7-45dc-b03a-5d842c547c2c None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:26.518527 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:26.519500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:26.519900 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:26.520179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] PATH_INFO: `/v3/projects/cda99da6c0d94bb29d1341a1c32d2367` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:26.521433 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda99da6c0d94bb29d1341a1c32d2367)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:26.524327 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:26.593697 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda99da6c0d94bb29d1341a1c32d2367', 'request_id': 'req-6522ed8f-4575-489a-96cf-62bfe836f961'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.602800 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda99da6c0d94bb29d1341a1c32d2367', 'request_id': 'req-6522ed8f-4575-489a-96cf-62bfe836f961'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.609801 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda99da6c0d94bb29d1341a1c32d2367', 'request_id': 'req-6522ed8f-4575-489a-96cf-62bfe836f961'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.622009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] The token cache is being invalidate because project cda99da6c0d94bb29d1341a1c32d2367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:42:26.622297 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.622950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.624668 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1359/2718] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:42:26 2022] DELETE /identity/v3/projects/cda99da6c0d94bb29d1341a1c32d2367 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:26.628571 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:26.630007 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:26.643568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fdd2a-5428-4dc7-b7f9-74e2cf219651 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:26.705134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:26.705818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:26.706309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:26.706595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] PATH_INFO: `/v3/users/967e8b0c9ac44aaba241ddafe0ebd617` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:26.707775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967e8b0c9ac44aaba241ddafe0ebd617)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:26.710337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:26.759539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967e8b0c9ac44aaba241ddafe0ebd617'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.768855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967e8b0c9ac44aaba241ddafe0ebd617'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.777193 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967e8b0c9ac44aaba241ddafe0ebd617'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.778133 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967e8b0c9ac44aaba241ddafe0ebd617'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.778948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6aecc9f1-8224-4204-8fa4-c1fad794b215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967e8b0c9ac44aaba241ddafe0ebd617'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:26.787728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:26.800495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1360/2719] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:42:26 2022] DELETE /identity/v3/users/967e8b0c9ac44aaba241ddafe0ebd617 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:26.984386 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:26.985975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:26.999821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522ed8f-4575-489a-96cf-62bfe836f961 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:27.059992 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:27.060633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.060910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.061184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] PATH_INFO: `/v3/projects/de8e5c9b87c24da1904f892af1eae230` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.062368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8e5c9b87c24da1904f892af1eae230)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:27.064263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:27.101112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:27.120600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8e5c9b87c24da1904f892af1eae230', 'request_id': 'req-5d60b1bb-2180-4861-bdf2-febf35ae32db'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:27.129142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8e5c9b87c24da1904f892af1eae230', 'request_id': 'req-5d60b1bb-2180-4861-bdf2-febf35ae32db'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:27.136101 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8e5c9b87c24da1904f892af1eae230', 'request_id': 'req-5d60b1bb-2180-4861-bdf2-febf35ae32db'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:27.148318 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] The token cache is being invalidate because project de8e5c9b87c24da1904f892af1eae230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:42:27.148607 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:27.149268 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5d60b1bb-2180-4861-bdf2-febf35ae32db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:27.150841 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1360/2720] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:42:26 2022] DELETE /identity/v3/projects/de8e5c9b87c24da1904f892af1eae230 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:42:27.155685 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b432-55dc-440e-9a26-38f04511a4eb None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.156129 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b432-55dc-440e-9a26-38f04511a4eb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.156231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b432-55dc-440e-9a26-38f04511a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.176651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7394b432-55dc-440e-9a26-38f04511a4eb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:27.177832 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7394b432-55dc-440e-9a26-38f04511a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:27.236134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1361/2721] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:27.243850 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42259ca6-de47-430b-be97-e2c5715bfc22 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.244127 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42259ca6-de47-430b-be97-e2c5715bfc22 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.244396 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42259ca6-de47-430b-be97-e2c5715bfc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.263640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-42259ca6-de47-430b-be97-e2c5715bfc22 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:27.264820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-42259ca6-de47-430b-be97-e2c5715bfc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:27.273026 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1361/2722] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:27.277039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b432-55dc-440e-9a26-38f04511a4eb None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:27.286719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b432-55dc-440e-9a26-38f04511a4eb None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:27.291738 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9242aa0-9ce2-4df4-9006-e0720cd72176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:27.292362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9242aa0-9ce2-4df4-9006-e0720cd72176 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.292636 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9242aa0-9ce2-4df4-9006-e0720cd72176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.292905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9242aa0-9ce2-4df4-9006-e0720cd72176 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.293621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9242aa0-9ce2-4df4-9006-e0720cd72176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:42:27.293919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9242aa0-9ce2-4df4-9006-e0720cd72176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:27.295520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9242aa0-9ce2-4df4-9006-e0720cd72176 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:27.306970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1362/2723] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:42:27.311011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42259ca6-de47-430b-be97-e2c5715bfc22 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:27.319985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42259ca6-de47-430b-be97-e2c5715bfc22 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:27.324477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4340ee-0b49-49dc-8689-5748d298c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:27.325064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4340ee-0b49-49dc-8689-5748d298c5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.325352 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4340ee-0b49-49dc-8689-5748d298c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.325638 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4340ee-0b49-49dc-8689-5748d298c5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.326289 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4340ee-0b49-49dc-8689-5748d298c5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:27.328137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4340ee-0b49-49dc-8689-5748d298c5f7 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:27.355301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1362/2724] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:42:27 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:42:27.359284 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9242aa0-9ce2-4df4-9006-e0720cd72176 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:27.369535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9242aa0-9ce2-4df4-9006-e0720cd72176 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:27.427462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e88280-427b-4c4e-8ce6-6231c927503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:27.428047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e88280-427b-4c4e-8ce6-6231c927503a admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.428325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e88280-427b-4c4e-8ce6-6231c927503a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.428599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e88280-427b-4c4e-8ce6-6231c927503a admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.429251 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e88280-427b-4c4e-8ce6-6231c927503a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:27.431225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e88280-427b-4c4e-8ce6-6231c927503a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:27.452621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1363/2725] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:42:27 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:42:27.456664 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4340ee-0b49-49dc-8689-5748d298c5f7 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:27.467565 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4340ee-0b49-49dc-8689-5748d298c5f7 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:27.472087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e2e3b-10df-446b-a324-05ffaa6b1eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:27.472686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2e3b-10df-446b-a324-05ffaa6b1eda admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.472963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2e3b-10df-446b-a324-05ffaa6b1eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.473231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2e3b-10df-446b-a324-05ffaa6b1eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.474010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e2e3b-10df-446b-a324-05ffaa6b1eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:27.475602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e2e3b-10df-446b-a324-05ffaa6b1eda admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:27.485169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1363/2726] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:27.488983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e88280-427b-4c4e-8ce6-6231c927503a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:27.499211 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e88280-427b-4c4e-8ce6-6231c927503a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:27.503711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b846dc-4278-42fa-817f-6ef7f74c38c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:27.504305 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b846dc-4278-42fa-817f-6ef7f74c38c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.504578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b846dc-4278-42fa-817f-6ef7f74c38c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.504856 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b846dc-4278-42fa-817f-6ef7f74c38c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.505575 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b846dc-4278-42fa-817f-6ef7f74c38c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:27.507883 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b846dc-4278-42fa-817f-6ef7f74c38c6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:27.519475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1364/2727] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:27.524005 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e2e3b-10df-446b-a324-05ffaa6b1eda admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:27.533650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e2e3b-10df-446b-a324-05ffaa6b1eda admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:27.538132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2cb0-8a0a-4e0b-bf4b-b6d55c100e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:27.538772 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2cb0-8a0a-4e0b-bf4b-b6d55c100e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.539048 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2cb0-8a0a-4e0b-bf4b-b6d55c100e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.539320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f2cb0-8a0a-4e0b-bf4b-b6d55c100e6b admin admin] PATH_INFO: `/v3/projects/712f1462e0f548af950cf2ce0725dee1/users/1333e6d44776452f9bac69d2ea9c8753/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.553505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f2cb0-8a0a-4e0b-bf4b-b6d55c100e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=712f1462e0f548af950cf2ce0725dee1, user_id=1333e6d44776452f9bac69d2ea9c8753, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:27.556111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f2cb0-8a0a-4e0b-bf4b-b6d55c100e6b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:27.570499 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1364/2728] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:42:27 2022] PUT /identity/v3/projects/712f1462e0f548af950cf2ce0725dee1/users/1333e6d44776452f9bac69d2ea9c8753/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:27.580793 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e71e5-470c-46bc-b018-f3bf800c17df None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.581073 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e71e5-470c-46bc-b018-f3bf800c17df None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.581381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e71e5-470c-46bc-b018-f3bf800c17df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.613462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-745e71e5-470c-46bc-b018-f3bf800c17df None None] MFA Rules not processed for user `1333e6d44776452f9bac69d2ea9c8753`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:27.614707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-745e71e5-470c-46bc-b018-f3bf800c17df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:27.659328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:27.680580 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1365/2729] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:27.691404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2cb0-8a0a-4e0b-bf4b-b6d55c100e6b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:27.693065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-078f2cb0-8a0a-4e0b-bf4b-b6d55c100e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:27.749378 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f2cb0-8a0a-4e0b-bf4b-b6d55c100e6b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:27.753009 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c1e67-c969-4bdc-801c-b09a18dc2d82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2ef9088a9941ddb4b163f282a1f7d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:27.753663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c1e67-c969-4bdc-801c-b09a18dc2d82 service glance] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:27.753942 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c1e67-c969-4bdc-801c-b09a18dc2d82 service glance] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:27.754208 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c1e67-c969-4bdc-801c-b09a18dc2d82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:27.762939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c1e67-c969-4bdc-801c-b09a18dc2d82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:27.764344 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c1e67-c969-4bdc-801c-b09a18dc2d82 service glance] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:27.773717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1365/2730] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:37.677707 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:37.769142 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:41.135174 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e71e5-470c-46bc-b018-f3bf800c17df None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:41.196249 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e71e5-470c-46bc-b018-f3bf800c17df None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:41.201321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:41.201988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:41.202266 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:41.202539 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] PATH_INFO: `/v3/users/1333e6d44776452f9bac69d2ea9c8753` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:41.203701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1333e6d44776452f9bac69d2ea9c8753)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:41.205655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:41.250935 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1333e6d44776452f9bac69d2ea9c8753'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.258047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1333e6d44776452f9bac69d2ea9c8753'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.265438 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1333e6d44776452f9bac69d2ea9c8753'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.266061 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1333e6d44776452f9bac69d2ea9c8753'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.266658 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1333e6d44776452f9bac69d2ea9c8753'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.284005 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1366/2731] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:42:41 2022] DELETE /identity/v3/users/1333e6d44776452f9bac69d2ea9c8753 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:41.288452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6bdfc-3d61-4157-8c4f-fa827242ec68 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:41.288931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6bdfc-3d61-4157-8c4f-fa827242ec68 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:41.289032 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6bdfc-3d61-4157-8c4f-fa827242ec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:41.307350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-fad6bdfc-3d61-4157-8c4f-fa827242ec68 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:41.308532 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fad6bdfc-3d61-4157-8c4f-fa827242ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:41.365612 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1366/2732] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:41.375588 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:41.376947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:41.435743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121b1cf-b795-491a-954b-beb87494d8c7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:41.439469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bb5e0-c842-4b99-a392-f1ed9e2b0d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:41.440079 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bb5e0-c842-4b99-a392-f1ed9e2b0d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:41.440356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bb5e0-c842-4b99-a392-f1ed9e2b0d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:41.440645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bb5e0-c842-4b99-a392-f1ed9e2b0d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:41.449646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bb5e0-c842-4b99-a392-f1ed9e2b0d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:41.451055 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bb5e0-c842-4b99-a392-f1ed9e2b0d35 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:41.460314 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1367/2733] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:41.721129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6bdfc-3d61-4157-8c4f-fa827242ec68 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:41.722636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fad6bdfc-3d61-4157-8c4f-fa827242ec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:41.739392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6bdfc-3d61-4157-8c4f-fa827242ec68 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:41.746260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:41.746991 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:41.747156 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:41.747435 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] PATH_INFO: `/v3/projects/712f1462e0f548af950cf2ce0725dee1` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:41.748613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=712f1462e0f548af950cf2ce0725dee1)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:41.750652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:41.798577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712f1462e0f548af950cf2ce0725dee1', 'request_id': 'req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.807001 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712f1462e0f548af950cf2ce0725dee1', 'request_id': 'req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.814349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712f1462e0f548af950cf2ce0725dee1', 'request_id': 'req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.826770 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] The token cache is being invalidate because project 712f1462e0f548af950cf2ce0725dee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:42:41.827066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.827750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f992a5-35e7-4f02-b5d2-fbea0c6829fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:42:41.829516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1367/2734] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:42:41 2022] DELETE /identity/v3/projects/712f1462e0f548af950cf2ce0725dee1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:41.836176 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294937-29e5-4333-876c-0409556c7864 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:41.836593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294937-29e5-4333-876c-0409556c7864 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:41.836936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4294937-29e5-4333-876c-0409556c7864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:41.858822 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f4294937-29e5-4333-876c-0409556c7864 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:41.860037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f4294937-29e5-4333-876c-0409556c7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:41.879263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:41.928888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1368/2735] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:42:41.936655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565adb1-6f81-408d-9b9b-fbb754e8d561 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:41.936937 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565adb1-6f81-408d-9b9b-fbb754e8d561 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:41.937206 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565adb1-6f81-408d-9b9b-fbb754e8d561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:41.956967 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-f565adb1-6f81-408d-9b9b-fbb754e8d561 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:41.958179 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f565adb1-6f81-408d-9b9b-fbb754e8d561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:41.966529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1368/2736] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:41.970597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294937-29e5-4333-876c-0409556c7864 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:41.980112 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4294937-29e5-4333-876c-0409556c7864 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:41.984595 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaf22e-0fef-4fb1-a2fd-000d995fb5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:41.985187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaf22e-0fef-4fb1-a2fd-000d995fb5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:41.985502 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaf22e-0fef-4fb1-a2fd-000d995fb5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:41.985774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaf22e-0fef-4fb1-a2fd-000d995fb5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:41.986449 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfaf22e-0fef-4fb1-a2fd-000d995fb5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:42:41.986753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfaf22e-0fef-4fb1-a2fd-000d995fb5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:41.988324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfaf22e-0fef-4fb1-a2fd-000d995fb5d4 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:41.999985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1369/2737] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:42:42.004121 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565adb1-6f81-408d-9b9b-fbb754e8d561 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:42.013827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565adb1-6f81-408d-9b9b-fbb754e8d561 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:42.018463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1370-4c47-4555-8761-9d72e58fde75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:42.019055 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1370-4c47-4555-8761-9d72e58fde75 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:42.019336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1370-4c47-4555-8761-9d72e58fde75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:42.019606 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1370-4c47-4555-8761-9d72e58fde75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:42.020265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb1370-4c47-4555-8761-9d72e58fde75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:42.022192 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb1370-4c47-4555-8761-9d72e58fde75 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:42.049939 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1369/2738] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:42:42 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:42:42.053957 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaf22e-0fef-4fb1-a2fd-000d995fb5d4 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:42.063753 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaf22e-0fef-4fb1-a2fd-000d995fb5d4 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:42.123698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151430-6871-413a-91ad-cc24cf3e5878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:42.124341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151430-6871-413a-91ad-cc24cf3e5878 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:42.124619 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151430-6871-413a-91ad-cc24cf3e5878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:42.124889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151430-6871-413a-91ad-cc24cf3e5878 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:42.125584 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37151430-6871-413a-91ad-cc24cf3e5878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:42.127538 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37151430-6871-413a-91ad-cc24cf3e5878 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:42.147770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1370/2739] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:42:42 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:42:42.151859 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1370-4c47-4555-8761-9d72e58fde75 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:42.163034 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1370-4c47-4555-8761-9d72e58fde75 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:42.167662 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d3f3-174f-4902-bc34-4ce65d0c0662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:42.168265 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d3f3-174f-4902-bc34-4ce65d0c0662 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:42.168546 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d3f3-174f-4902-bc34-4ce65d0c0662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:42.168823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d3f3-174f-4902-bc34-4ce65d0c0662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:42.169538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641d3f3-174f-4902-bc34-4ce65d0c0662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:42.171149 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641d3f3-174f-4902-bc34-4ce65d0c0662 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:42.181245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1370/2740] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:42.185067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151430-6871-413a-91ad-cc24cf3e5878 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:42.195041 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151430-6871-413a-91ad-cc24cf3e5878 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:42.200044 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def6825-de32-4d7a-92dc-75728b796ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:42.200631 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6825-de32-4d7a-92dc-75728b796ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:42.200911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6825-de32-4d7a-92dc-75728b796ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:42.201183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6825-de32-4d7a-92dc-75728b796ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:42.201895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def6825-de32-4d7a-92dc-75728b796ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:42.203467 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def6825-de32-4d7a-92dc-75728b796ad3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:42.214278 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1371/2741] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:42.218564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d3f3-174f-4902-bc34-4ce65d0c0662 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:42.228489 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d3f3-174f-4902-bc34-4ce65d0c0662 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:42.233113 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b76e5-074a-4aa4-b959-712abd97fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:42.233797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b76e5-074a-4aa4-b959-712abd97fa88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:42.234079 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b76e5-074a-4aa4-b959-712abd97fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:42.234353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b76e5-074a-4aa4-b959-712abd97fa88 admin admin] PATH_INFO: `/v3/projects/73d912fb2b264117bfb02f70afb57e98/users/3f91486179e94905b5fadef3e65fa59f/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:42.248838 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b76e5-074a-4aa4-b959-712abd97fa88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d912fb2b264117bfb02f70afb57e98, user_id=3f91486179e94905b5fadef3e65fa59f, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:42.251505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b76e5-074a-4aa4-b959-712abd97fa88 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:42.264982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1371/2742] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:42:42 2022] PUT /identity/v3/projects/73d912fb2b264117bfb02f70afb57e98/users/3f91486179e94905b5fadef3e65fa59f/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:42.269917 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22d0c-ec35-4979-842a-43472835f9df None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:42.270201 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22d0c-ec35-4979-842a-43472835f9df None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:42.270469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b22d0c-ec35-4979-842a-43472835f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:42.289966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c5b22d0c-ec35-4979-842a-43472835f9df None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:42.291183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c5b22d0c-ec35-4979-842a-43472835f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:42.347830 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1372/2743] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:42.357364 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b76e5-074a-4aa4-b959-712abd97fa88 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:42.359120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9b5b76e5-074a-4aa4-b959-712abd97fa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:42.381610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:42.419303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b76e5-074a-4aa4-b959-712abd97fa88 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:42.422952 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e930c-695b-4bb9-8c27-2242bef5e49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:42.423555 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e930c-695b-4bb9-8c27-2242bef5e49c service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:42.423833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e930c-695b-4bb9-8c27-2242bef5e49c service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:42.424105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e930c-695b-4bb9-8c27-2242bef5e49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:42.432978 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e930c-695b-4bb9-8c27-2242bef5e49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:42.435062 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e930c-695b-4bb9-8c27-2242bef5e49c service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:42.444867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1372/2744] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:46.327780 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e282e-2bdc-45c7-b6fd-4f9e9f4e68ef None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:46.328255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e282e-2bdc-45c7-b6fd-4f9e9f4e68ef None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:46.328359 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e282e-2bdc-45c7-b6fd-4f9e9f4e68ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:46.361487 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d77e282e-2bdc-45c7-b6fd-4f9e9f4e68ef None None] MFA Rules not processed for user `3f91486179e94905b5fadef3e65fa59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:46.362691 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d77e282e-2bdc-45c7-b6fd-4f9e9f4e68ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:46.380823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:46.450989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1373/2745] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:46.455477 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e930c-695b-4bb9-8c27-2242bef5e49c service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:46.466522 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e930c-695b-4bb9-8c27-2242bef5e49c service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:46.473214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977e809-5395-4536-af63-e80789f4b5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:46.473954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977e809-5395-4536-af63-e80789f4b5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:46.474306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977e809-5395-4536-af63-e80789f4b5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:46.474645 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977e809-5395-4536-af63-e80789f4b5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:46.475389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977e809-5395-4536-af63-e80789f4b5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:46.477451 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977e809-5395-4536-af63-e80789f4b5b7 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:46.510482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1373/2746] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:42:46 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:42:46.512163 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e282e-2bdc-45c7-b6fd-4f9e9f4e68ef None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:46.523760 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e282e-2bdc-45c7-b6fd-4f9e9f4e68ef None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:46.587586 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999f01-2882-4669-a89e-43a57ff0139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:46.588235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999f01-2882-4669-a89e-43a57ff0139e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:46.588518 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999f01-2882-4669-a89e-43a57ff0139e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:46.589115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999f01-2882-4669-a89e-43a57ff0139e admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:46.589581 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81999f01-2882-4669-a89e-43a57ff0139e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:46.592241 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81999f01-2882-4669-a89e-43a57ff0139e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:46.614907 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1374/2747] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:42:46 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:42:46.619011 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977e809-5395-4536-af63-e80789f4b5b7 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:46.632602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977e809-5395-4536-af63-e80789f4b5b7 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:46.639080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaacf2-fb24-4ded-b524-f83ea97336d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:46.639920 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaacf2-fb24-4ded-b524-f83ea97336d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:46.640354 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaacf2-fb24-4ded-b524-f83ea97336d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:46.640778 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaacf2-fb24-4ded-b524-f83ea97336d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:46.641674 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaacf2-fb24-4ded-b524-f83ea97336d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:46.643416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaacf2-fb24-4ded-b524-f83ea97336d2 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:46.657085 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1374/2748] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:46.661017 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999f01-2882-4669-a89e-43a57ff0139e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:46.673437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999f01-2882-4669-a89e-43a57ff0139e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:46.678548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e2ea6-7a0b-424e-8a19-7b093085bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:46.679217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e2ea6-7a0b-424e-8a19-7b093085bbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:46.679592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e2ea6-7a0b-424e-8a19-7b093085bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:46.679961 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e2ea6-7a0b-424e-8a19-7b093085bbbf admin admin] PATH_INFO: `/v3/projects/1cb226c3126548c5884a4423b4bd5757/users/2ff734e9e1a14c6391e02f2adac5c63d/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:46.699912 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e2ea6-7a0b-424e-8a19-7b093085bbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb226c3126548c5884a4423b4bd5757, user_id=2ff734e9e1a14c6391e02f2adac5c63d, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:46.703342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e2ea6-7a0b-424e-8a19-7b093085bbbf admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:46.721356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1375/2749] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:42:46 2022] PUT /identity/v3/projects/1cb226c3126548c5884a4423b4bd5757/users/2ff734e9e1a14c6391e02f2adac5c63d/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:46.725870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaacf2-fb24-4ded-b524-f83ea97336d2 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:46.738013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaacf2-fb24-4ded-b524-f83ea97336d2 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:46.808071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9a4e4-d8c6-42d3-bc32-512c7c520c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:46.809799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9a4e4-d8c6-42d3-bc32-512c7c520c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:46.810281 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9a4e4-d8c6-42d3-bc32-512c7c520c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:46.810830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9a4e4-d8c6-42d3-bc32-512c7c520c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:46.811691 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9a4e4-d8c6-42d3-bc32-512c7c520c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:46.813776 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9a4e4-d8c6-42d3-bc32-512c7c520c7c admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:46.829132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1375/2750] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:42:46.830587 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e2ea6-7a0b-424e-8a19-7b093085bbbf admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:46.844890 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e2ea6-7a0b-424e-8a19-7b093085bbbf admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:46.849780 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9df7f-358a-48f2-8993-bb4744c60afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:46.850604 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9df7f-358a-48f2-8993-bb4744c60afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:46.850887 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9df7f-358a-48f2-8993-bb4744c60afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:46.851183 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9df7f-358a-48f2-8993-bb4744c60afb admin admin] PATH_INFO: `/v3/projects/1cb226c3126548c5884a4423b4bd5757/users/2ff734e9e1a14c6391e02f2adac5c63d/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:46.853662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9df7f-358a-48f2-8993-bb4744c60afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb226c3126548c5884a4423b4bd5757, user_id=2ff734e9e1a14c6391e02f2adac5c63d, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:46.856954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9df7f-358a-48f2-8993-bb4744c60afb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:46.873037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1376/2751] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:42:46 2022] PUT /identity/v3/projects/1cb226c3126548c5884a4423b4bd5757/users/2ff734e9e1a14c6391e02f2adac5c63d/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:42:51.877202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e870-b4fe-407d-acec-77eb067398d4 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:51.878337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e870-b4fe-407d-acec-77eb067398d4 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:51.878736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e870-b4fe-407d-acec-77eb067398d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:51.913096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-98c9e870-b4fe-407d-acec-77eb067398d4 None None] MFA Rules not processed for user `2ff734e9e1a14c6391e02f2adac5c63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:51.914536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-98c9e870-b4fe-407d-acec-77eb067398d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:52.001225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1376/2752] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:42:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:52.013110 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9df7f-358a-48f2-8993-bb4744c60afb admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:52.014871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-09f9df7f-358a-48f2-8993-bb4744c60afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:52.080096 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9df7f-358a-48f2-8993-bb4744c60afb admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:52.085220 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea0daa-4228-49ce-8ced-8d342734ae3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2ef9088a9941ddb4b163f282a1f7d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:52.085827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea0daa-4228-49ce-8ced-8d342734ae3a service glance] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:52.086221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea0daa-4228-49ce-8ced-8d342734ae3a service glance] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:52.086592 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea0daa-4228-49ce-8ced-8d342734ae3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:52.114322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:52.154801 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea0daa-4228-49ce-8ced-8d342734ae3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:52.156813 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea0daa-4228-49ce-8ced-8d342734ae3a service glance] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:52.171723 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1377/2753] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:42:52.344049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9929d0-6545-42d6-b14d-a8e0bb802215 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:52.344363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9929d0-6545-42d6-b14d-a8e0bb802215 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:52.344785 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9929d0-6545-42d6-b14d-a8e0bb802215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:52.392982 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-7b9929d0-6545-42d6-b14d-a8e0bb802215 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:42:52.394577 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7b9929d0-6545-42d6-b14d-a8e0bb802215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:52.418450 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:42:52.454067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea0daa-4228-49ce-8ced-8d342734ae3a service glance] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:52.456705 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e1ea0daa-4228-49ce-8ced-8d342734ae3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:52.509907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1377/2754] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:42:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:42:52.530767 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea0daa-4228-49ce-8ced-8d342734ae3a service glance] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:52.535021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:52.536233 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:52.536597 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:52.536943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:52.538933 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:52.577080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9929d0-6545-42d6-b14d-a8e0bb802215 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:42:52.578654 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7b9929d0-6545-42d6-b14d-a8e0bb802215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:42:52.623895 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:52.625532 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:52.637381 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1378/2755] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:42:52.656099 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9929d0-6545-42d6-b14d-a8e0bb802215 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:42:52.661700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08396167-ebfb-43c7-93ee-176789a65d2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:42:52.662412 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08396167-ebfb-43c7-93ee-176789a65d2a service swift] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:42:52.662768 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08396167-ebfb-43c7-93ee-176789a65d2a service swift] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:42:52.663111 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08396167-ebfb-43c7-93ee-176789a65d2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:42:52.673139 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08396167-ebfb-43c7-93ee-176789a65d2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:42:52.674862 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08396167-ebfb-43c7-93ee-176789a65d2a service swift] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:42:52.684500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1378/2756] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:42:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 02:43:01.205985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:01.208057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:01.243274 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78fb2f-7ff5-4838-9adc-04123561f987 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:01.268796 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:01.269858 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:01.270147 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:01.270430 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] PATH_INFO: `/v3/users/886527dcd4364610a2eba1eb2df3f3ce` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:01.277223 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886527dcd4364610a2eba1eb2df3f3ce)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:01.289416 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:01.343255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886527dcd4364610a2eba1eb2df3f3ce'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.354214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886527dcd4364610a2eba1eb2df3f3ce'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.367095 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886527dcd4364610a2eba1eb2df3f3ce'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.367878 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886527dcd4364610a2eba1eb2df3f3ce'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.369105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886527dcd4364610a2eba1eb2df3f3ce'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.379170 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:01.401091 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1379/2757] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:01 2022] DELETE /identity/v3/users/886527dcd4364610a2eba1eb2df3f3ce => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:01.614219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08396167-ebfb-43c7-93ee-176789a65d2a service swift] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:01.629594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08396167-ebfb-43c7-93ee-176789a65d2a service swift] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:01.695350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:01.696002 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:01.696266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:01.696540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] PATH_INFO: `/v3/projects/6d2b00bab367473199ed7c29ad5493f8` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:01.697726 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2b00bab367473199ed7c29ad5493f8)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:01.700295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:01.760146 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:01.766122 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2b00bab367473199ed7c29ad5493f8', 'request_id': 'req-981d9d80-0549-4031-8cc5-0c7ac4195ab0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.781875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2b00bab367473199ed7c29ad5493f8', 'request_id': 'req-981d9d80-0549-4031-8cc5-0c7ac4195ab0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.795986 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2b00bab367473199ed7c29ad5493f8', 'request_id': 'req-981d9d80-0549-4031-8cc5-0c7ac4195ab0'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.812602 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] The token cache is being invalidate because project 6d2b00bab367473199ed7c29ad5493f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:43:01.813069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.813829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:01.816040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1379/2758] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:43:01 2022] DELETE /identity/v3/projects/6d2b00bab367473199ed7c29ad5493f8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:01.819968 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:01.824398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:01.840456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150023ef-712f-42aa-9942-c0af69810fd1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:01.918770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:01.919701 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:01.920114 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:01.920663 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] PATH_INFO: `/v3/users/5ddd3205277a40d48174f606ecb4cfe0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:01.921986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddd3205277a40d48174f606ecb4cfe0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:01.925267 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:02.015322 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddd3205277a40d48174f606ecb4cfe0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.041386 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddd3205277a40d48174f606ecb4cfe0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.053476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddd3205277a40d48174f606ecb4cfe0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.054279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddd3205277a40d48174f606ecb4cfe0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.054955 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-18b8c8cb-9604-4e90-87cc-44a2e198bdb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddd3205277a40d48174f606ecb4cfe0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.104228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1380/2759] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:43:01 2022] DELETE /identity/v3/users/5ddd3205277a40d48174f606ecb4cfe0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:02.355965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:02.360104 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:02.402261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d9d80-0549-4031-8cc5-0c7ac4195ab0 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:02.498761 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:02.499509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:02.499509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:02.499509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] PATH_INFO: `/v3/projects/cc66f7ea62d144ad8657a328f42be42f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:02.500893 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc66f7ea62d144ad8657a328f42be42f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:02.503126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:02.567950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc66f7ea62d144ad8657a328f42be42f', 'request_id': 'req-f77dbeda-9848-40ee-85c4-88c19e135fc9'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.581049 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc66f7ea62d144ad8657a328f42be42f', 'request_id': 'req-f77dbeda-9848-40ee-85c4-88c19e135fc9'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.588323 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc66f7ea62d144ad8657a328f42be42f', 'request_id': 'req-f77dbeda-9848-40ee-85c4-88c19e135fc9'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.602119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] The token cache is being invalidate because project cc66f7ea62d144ad8657a328f42be42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:43:02.602414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.603098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f77dbeda-9848-40ee-85c4-88c19e135fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:43:02.604972 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1380/2760] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:43:02 2022] DELETE /identity/v3/projects/cc66f7ea62d144ad8657a328f42be42f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:43:03.447948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d7618-118f-49be-bdeb-a2005e6df315 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:03.448529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d7618-118f-49be-bdeb-a2005e6df315 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:03.448628 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d7618-118f-49be-bdeb-a2005e6df315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:03.469037 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-536d7618-118f-49be-bdeb-a2005e6df315 None None] MFA Rules not processed for user `3f91486179e94905b5fadef3e65fa59f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:03.470440 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-536d7618-118f-49be-bdeb-a2005e6df315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:03.660225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1381/2761] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:43:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:05.412628 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d4b4b-110f-436c-8490-106d1d972346 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.413060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d4b4b-110f-436c-8490-106d1d972346 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.413060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d4b4b-110f-436c-8490-106d1d972346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.435861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-288d4b4b-110f-436c-8490-106d1d972346 None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:05.437261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-288d4b4b-110f-436c-8490-106d1d972346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:05.494429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1381/2762] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Aug 4 02:43:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:05.507263 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d7618-118f-49be-bdeb-a2005e6df315 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:05.508800 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-536d7618-118f-49be-bdeb-a2005e6df315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:05.523870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:05.600227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d7618-118f-49be-bdeb-a2005e6df315 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:05.605872 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db5571-53d2-40a8-a2bc-d8640c47322d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:05.606490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db5571-53d2-40a8-a2bc-d8640c47322d service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:05.606765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db5571-53d2-40a8-a2bc-d8640c47322d service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:05.607036 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db5571-53d2-40a8-a2bc-d8640c47322d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:05.615683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db5571-53d2-40a8-a2bc-d8640c47322d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:05.617257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db5571-53d2-40a8-a2bc-d8640c47322d service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:05.626568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1382/2763] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:43:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 02:43:07.163570 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d12a2-d33d-4c33-8e5d-7a5e9da55e7b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:07.164237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d12a2-d33d-4c33-8e5d-7a5e9da55e7b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:07.164237 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d12a2-d33d-4c33-8e5d-7a5e9da55e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:07.184325 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-4e7d12a2-d33d-4c33-8e5d-7a5e9da55e7b None None] MFA Rules not processed for user `1160278ef4e347dda8ca86a82535f416`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:43:07.185676 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4e7d12a2-d33d-4c33-8e5d-7a5e9da55e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:07.191234 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:07.252004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1382/2764] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:43:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:43:07.577517 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db5571-53d2-40a8-a2bc-d8640c47322d service swift] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:07.578965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a1db5571-53d2-40a8-a2bc-d8640c47322d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:07.643469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db5571-53d2-40a8-a2bc-d8640c47322d service swift] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:07.647179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:07.647826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:07.648103 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:07.648399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:07.650351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:07.660652 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:07.662134 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:07.670643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1383/2765] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:17.239843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=20 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:17.667077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=53 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:23.474468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d12a2-d33d-4c33-8e5d-7a5e9da55e7b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:23.475954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-4e7d12a2-d33d-4c33-8e5d-7a5e9da55e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:23.563610 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d12a2-d33d-4c33-8e5d-7a5e9da55e7b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:23.569316 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0096da9bf564ceca61af67cac713f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:23.569993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:23.570266 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:23.570536 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:23.572358 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:23.586065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:23.587660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:23.599040 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1383/2766] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:28.405015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:43:28.406460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:28.417235 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128bf27-192e-4868-884d-f0153fbd8f57 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:43:28.420796 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f4217-7f29-48c7-a5f6-26c911fc255a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:43:28.421425 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f4217-7f29-48c7-a5f6-26c911fc255a service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:43:28.421703 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f4217-7f29-48c7-a5f6-26c911fc255a service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:43:28.421970 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f4217-7f29-48c7-a5f6-26c911fc255a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:43:28.423843 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bb8f4217-7f29-48c7-a5f6-26c911fc255a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:43:28.484591 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f4217-7f29-48c7-a5f6-26c911fc255a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:43:28.485962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f4217-7f29-48c7-a5f6-26c911fc255a service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:43:28.495535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1384/2767] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:43:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:43:33.594238 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=34 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:43:38.491131 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=30 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:02.221291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:02.222820 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:02.410659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cecee-8cce-4fc5-8fbd-7b15351ca1fb service nova] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:02.415827 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a8e08-0253-4901-9d23-eb0add59a23f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:02.416444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8e08-0253-4901-9d23-eb0add59a23f service placement] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:02.416736 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8e08-0253-4901-9d23-eb0add59a23f service placement] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:02.416998 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a8e08-0253-4901-9d23-eb0add59a23f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:02.419626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-083a8e08-0253-4901-9d23-eb0add59a23f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:02.431755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a8e08-0253-4901-9d23-eb0add59a23f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:02.433317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a8e08-0253-4901-9d23-eb0add59a23f service placement] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:02.445063 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1384/2768] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:44:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:44:10.922675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e613a-1e60-4841-99a5-15c6d2a51f12 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:10.923189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e613a-1e60-4841-99a5-15c6d2a51f12 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:10.923189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e613a-1e60-4841-99a5-15c6d2a51f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:10.941391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c51e613a-1e60-4841-99a5-15c6d2a51f12 None None] MFA Rules not processed for user `1160278ef4e347dda8ca86a82535f416`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:10.942571 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c51e613a-1e60-4841-99a5-15c6d2a51f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:10.949268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1385/2769] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:44:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:12.441068 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=63 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:20.936341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:44:54.763575 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07c7fe-e438-4bea-ab0e-0f0cc115238b None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:54.764059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07c7fe-e438-4bea-ab0e-0f0cc115238b None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:54.764165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07c7fe-e438-4bea-ab0e-0f0cc115238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:54.793302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-7b07c7fe-e438-4bea-ab0e-0f0cc115238b None None] MFA Rules not processed for user `758a5ce9caf046929eec499e6afc1dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:44:54.794541 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7b07c7fe-e438-4bea-ab0e-0f0cc115238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:44:54.809047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1385/2770] 10.222.0.69 () {58 vars in 967 bytes} [Thu Aug 4 02:44:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:44:54.852342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e613a-1e60-4841-99a5-15c6d2a51f12 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:44:54.865746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e613a-1e60-4841-99a5-15c6d2a51f12 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:44:54.871001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58a61-c7f8-40c5-9016-e7b4861d5f0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e996ea899e4bf8a65b721628a044ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:44:54.871699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58a61-c7f8-40c5-9016-e7b4861d5f0a service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:44:54.871979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58a61-c7f8-40c5-9016-e7b4861d5f0a service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:44:54.872255 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec58a61-c7f8-40c5-9016-e7b4861d5f0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:44:54.880676 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58a61-c7f8-40c5-9016-e7b4861d5f0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:44:54.882463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec58a61-c7f8-40c5-9016-e7b4861d5f0a service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:44:54.892053 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1386/2771] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Aug 4 02:44:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 02:45:01.894709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07c7fe-e438-4bea-ab0e-0f0cc115238b None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:01.896337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-7b07c7fe-e438-4bea-ab0e-0f0cc115238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:02.004642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07c7fe-e438-4bea-ab0e-0f0cc115238b None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:02.009303 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:02.010174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:02.010302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:02.011167 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] PATH_INFO: `/v3/users/3f91486179e94905b5fadef3e65fa59f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:02.012349 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f91486179e94905b5fadef3e65fa59f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:02.014293 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:02.064385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f91486179e94905b5fadef3e65fa59f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.073965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f91486179e94905b5fadef3e65fa59f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.081474 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f91486179e94905b5fadef3e65fa59f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.082219 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f91486179e94905b5fadef3e65fa59f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.095434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f91486179e94905b5fadef3e65fa59f'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.103092 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1386/2772] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:45:01 2022] DELETE /identity/v3/users/3f91486179e94905b5fadef3e65fa59f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:45:02.296874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58a61-c7f8-40c5-9016-e7b4861d5f0a service swift] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:02.313657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec58a61-c7f8-40c5-9016-e7b4861d5f0a service swift] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:02.374820 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:02.375584 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:02.376192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:02.376192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] PATH_INFO: `/v3/projects/73d912fb2b264117bfb02f70afb57e98` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:02.377245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d912fb2b264117bfb02f70afb57e98)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:02.379158 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:02.427476 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d912fb2b264117bfb02f70afb57e98', 'request_id': 'req-ae6cbc4f-0bce-4d79-95d4-87349de42609'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.434686 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d912fb2b264117bfb02f70afb57e98', 'request_id': 'req-ae6cbc4f-0bce-4d79-95d4-87349de42609'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.440402 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d912fb2b264117bfb02f70afb57e98', 'request_id': 'req-ae6cbc4f-0bce-4d79-95d4-87349de42609'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.452106 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] The token cache is being invalidate because project 73d912fb2b264117bfb02f70afb57e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:45:02.452397 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.453033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.454550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1387/2773] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:45:02 2022] DELETE /identity/v3/projects/73d912fb2b264117bfb02f70afb57e98 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:45:02.458657 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:02.460079 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:02.475642 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2611806-ee76-43fd-a37f-c7ff065fe000 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:02.510019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:02.544779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:02.545531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:02.545886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:02.546231 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] PATH_INFO: `/v3/users/2ff734e9e1a14c6391e02f2adac5c63d` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:02.547428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff734e9e1a14c6391e02f2adac5c63d)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:02.549356 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:02.596417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff734e9e1a14c6391e02f2adac5c63d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.605218 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff734e9e1a14c6391e02f2adac5c63d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.612713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff734e9e1a14c6391e02f2adac5c63d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.613320 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff734e9e1a14c6391e02f2adac5c63d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.627023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b42927ae-80e3-40a4-9ebb-d005029a41ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff734e9e1a14c6391e02f2adac5c63d'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.633285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1387/2774] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:45:02 2022] DELETE /identity/v3/users/2ff734e9e1a14c6391e02f2adac5c63d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:45:02.812459 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:02.813618 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:02.832690 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cbc4f-0bce-4d79-95d4-87349de42609 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:02.922271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:02.922952 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:02.923602 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:02.923602 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] PATH_INFO: `/v3/projects/1cb226c3126548c5884a4423b4bd5757` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:02.924775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb226c3126548c5884a4423b4bd5757)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:02.926709 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:02.951184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:02.983408 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb226c3126548c5884a4423b4bd5757', 'request_id': 'req-db7e9b84-20be-4c61-81fc-7906f0813ae4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:02.992355 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb226c3126548c5884a4423b4bd5757', 'request_id': 'req-db7e9b84-20be-4c61-81fc-7906f0813ae4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:03.002028 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb226c3126548c5884a4423b4bd5757', 'request_id': 'req-db7e9b84-20be-4c61-81fc-7906f0813ae4'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:03.013543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] The token cache is being invalidate because project 1cb226c3126548c5884a4423b4bd5757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:45:03.013827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:03.014460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:03.015994 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1388/2775] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:45:02 2022] DELETE /identity/v3/projects/1cb226c3126548c5884a4423b4bd5757 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:45:04.760383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8f75-0d7b-45bd-a534-df68265b8a1e None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:04.761402 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8f75-0d7b-45bd-a534-df68265b8a1e None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:04.761506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8f75-0d7b-45bd-a534-df68265b8a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:04.780004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-2dec8f75-0d7b-45bd-a534-df68265b8a1e None None] MFA Rules not processed for user `1160278ef4e347dda8ca86a82535f416`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:45:04.781200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2dec8f75-0d7b-45bd-a534-df68265b8a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:04.835160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1388/2776] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:45:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:45:13.010640 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:14.828343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:49.713748 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:49.715138 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:49.792682 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e9b84-20be-4c61-81fc-7906f0813ae4 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:49.796151 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:49.796742 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:49.797014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:49.797279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:49.798996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:49.878231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:49.879576 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:49.899732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1389/2777] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:45:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:51.086693 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8f75-0d7b-45bd-a534-df68265b8a1e None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:51.088217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2dec8f75-0d7b-45bd-a534-df68265b8a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:51.101261 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8f75-0d7b-45bd-a534-df68265b8a1e None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:51.104825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:51.105472 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:51.105750 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:51.106023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:51.107904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:51.122687 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:51.124598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:51.139346 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1389/2778] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:45:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:59.599990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:59.601475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:59.666740 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:45:59.668194 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:59.675495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:45:59.681108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c783fd-73ca-4db4-9bb0-7f4795c1deff service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:59.687550 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fea429-5413-4c6d-88ee-c1358a57b00f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:59.688258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea429-5413-4c6d-88ee-c1358a57b00f service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:59.688573 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea429-5413-4c6d-88ee-c1358a57b00f service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:59.688853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea429-5413-4c6d-88ee-c1358a57b00f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:59.691113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c5fea429-5413-4c6d-88ee-c1358a57b00f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:45:59.705015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fea429-5413-4c6d-88ee-c1358a57b00f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:59.706627 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fea429-5413-4c6d-88ee-c1358a57b00f service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:59.716622 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1390/2779] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:45:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:45:59.738469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4ddf3-04f7-48db-bedf-e00cc421d648 service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:45:59.742975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:45:59.743605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:45:59.743887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:45:59.744154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] PATH_INFO: `/v3/users/1160278ef4e347dda8ca86a82535f416` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:45:59.745321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1160278ef4e347dda8ca86a82535f416)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:45:59.747245 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:45:59.792019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1160278ef4e347dda8ca86a82535f416'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:59.798983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1160278ef4e347dda8ca86a82535f416'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:59.805787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1160278ef4e347dda8ca86a82535f416'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:59.806407 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1160278ef4e347dda8ca86a82535f416'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:59.819114 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-7fe7ffb6-3bb5-45fb-9b0a-69a56a957de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1160278ef4e347dda8ca86a82535f416'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:45:59.824956 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1390/2780] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:45:59 2022] DELETE /identity/v3/users/1160278ef4e347dda8ca86a82535f416 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:00.002039 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fea429-5413-4c6d-88ee-c1358a57b00f service placement] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:00.012889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fea429-5413-4c6d-88ee-c1358a57b00f service placement] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:00.068829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:00.069496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.069777 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.070051 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] PATH_INFO: `/v3/projects/a65007945367413a8389d49a2099f948` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.071189 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65007945367413a8389d49a2099f948)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:00.073087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:00.119008 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65007945367413a8389d49a2099f948', 'request_id': 'req-b3271642-1b62-49cf-9776-c2f1fe3d93ae'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:00.125928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65007945367413a8389d49a2099f948', 'request_id': 'req-b3271642-1b62-49cf-9776-c2f1fe3d93ae'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:00.131334 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65007945367413a8389d49a2099f948', 'request_id': 'req-b3271642-1b62-49cf-9776-c2f1fe3d93ae'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:00.142068 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] The token cache is being invalidate because project a65007945367413a8389d49a2099f948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:00.142354 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:00.142976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b3271642-1b62-49cf-9776-c2f1fe3d93ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:00.144535 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1391/2781] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:00 2022] DELETE /identity/v3/projects/a65007945367413a8389d49a2099f948 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:46:00.149438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507619-6c85-40c7-961c-c4f4a1d57512 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.149722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507619-6c85-40c7-961c-c4f4a1d57512 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.149994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507619-6c85-40c7-961c-c4f4a1d57512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.206152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-29507619-6c85-40c7-961c-c4f4a1d57512 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:00.207347 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-29507619-6c85-40c7-961c-c4f4a1d57512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:00.237331 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:00.267012 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1391/2782] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:00.274744 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43ec1f-c0d0-469c-832d-fcb5656d01bf None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.275030 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43ec1f-c0d0-469c-832d-fcb5656d01bf None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.275299 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43ec1f-c0d0-469c-832d-fcb5656d01bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.294554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0e43ec1f-c0d0-469c-832d-fcb5656d01bf None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:00.296366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0e43ec1f-c0d0-469c-832d-fcb5656d01bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:00.303981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1392/2783] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:00.307997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507619-6c85-40c7-961c-c4f4a1d57512 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:00.317799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507619-6c85-40c7-961c-c4f4a1d57512 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:00.322343 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c97005-6b3c-4ff2-9b96-fe8bf7ac0a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:00.322935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c97005-6b3c-4ff2-9b96-fe8bf7ac0a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.323212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c97005-6b3c-4ff2-9b96-fe8bf7ac0a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.323485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c97005-6b3c-4ff2-9b96-fe8bf7ac0a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.324163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c97005-6b3c-4ff2-9b96-fe8bf7ac0a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:46:00.324462 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c97005-6b3c-4ff2-9b96-fe8bf7ac0a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:00.326077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c97005-6b3c-4ff2-9b96-fe8bf7ac0a50 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:00.337385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1392/2784] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:46:00.341199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43ec1f-c0d0-469c-832d-fcb5656d01bf None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:00.350641 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43ec1f-c0d0-469c-832d-fcb5656d01bf None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:00.355099 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a1ee-f264-4b57-ac7c-1366d77ac4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:00.355683 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a1ee-f264-4b57-ac7c-1366d77ac4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.355954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a1ee-f264-4b57-ac7c-1366d77ac4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.356218 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a1ee-f264-4b57-ac7c-1366d77ac4b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.356859 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a1ee-f264-4b57-ac7c-1366d77ac4b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:00.359291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a1ee-f264-4b57-ac7c-1366d77ac4b2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:00.395119 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1393/2785] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:00 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:00.399145 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c97005-6b3c-4ff2-9b96-fe8bf7ac0a50 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:00.409703 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c97005-6b3c-4ff2-9b96-fe8bf7ac0a50 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:00.464618 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14070b60-7fa7-43df-b306-2481364b2721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:00.465214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14070b60-7fa7-43df-b306-2481364b2721 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.465526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14070b60-7fa7-43df-b306-2481364b2721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.465797 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14070b60-7fa7-43df-b306-2481364b2721 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.466453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14070b60-7fa7-43df-b306-2481364b2721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:00.468931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14070b60-7fa7-43df-b306-2481364b2721 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:00.489202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1393/2786] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:00 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:46:00.493287 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a1ee-f264-4b57-ac7c-1366d77ac4b2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:00.503531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a1ee-f264-4b57-ac7c-1366d77ac4b2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:00.508026 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614433b-9bd1-4277-9d76-d96d60a2175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:00.508615 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614433b-9bd1-4277-9d76-d96d60a2175f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.508909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614433b-9bd1-4277-9d76-d96d60a2175f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.509160 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614433b-9bd1-4277-9d76-d96d60a2175f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.509874 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614433b-9bd1-4277-9d76-d96d60a2175f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:00.511436 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614433b-9bd1-4277-9d76-d96d60a2175f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:00.521977 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1394/2787] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:00.525567 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14070b60-7fa7-43df-b306-2481364b2721 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:00.535883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14070b60-7fa7-43df-b306-2481364b2721 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:00.540492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b7e9b-5736-456f-b2ab-73525050695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:00.541081 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b7e9b-5736-456f-b2ab-73525050695d admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.541389 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b7e9b-5736-456f-b2ab-73525050695d admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.541667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b7e9b-5736-456f-b2ab-73525050695d admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.542341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b7e9b-5736-456f-b2ab-73525050695d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:00.543896 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b7e9b-5736-456f-b2ab-73525050695d admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:00.554426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1394/2788] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:00.558437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614433b-9bd1-4277-9d76-d96d60a2175f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:00.568426 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614433b-9bd1-4277-9d76-d96d60a2175f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:00.573014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437248df-46bf-43b4-b182-3ea480769a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:00.573699 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437248df-46bf-43b4-b182-3ea480769a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.573981 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437248df-46bf-43b4-b182-3ea480769a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.574258 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437248df-46bf-43b4-b182-3ea480769a5f admin admin] PATH_INFO: `/v3/projects/03c5e778e0b8454a905fa071c5031f1a/users/c0d28fb10d5d4d37af1fc2f7333ee26b/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.589452 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437248df-46bf-43b4-b182-3ea480769a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c5e778e0b8454a905fa071c5031f1a, user_id=c0d28fb10d5d4d37af1fc2f7333ee26b, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:00.592717 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437248df-46bf-43b4-b182-3ea480769a5f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:00.605735 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1395/2789] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:00 2022] PUT /identity/v3/projects/03c5e778e0b8454a905fa071c5031f1a/users/c0d28fb10d5d4d37af1fc2f7333ee26b/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:00.610863 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0030-afc3-4c02-be75-988d6f265b0f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.611153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0030-afc3-4c02-be75-988d6f265b0f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.611434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c0030-afc3-4c02-be75-988d6f265b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.630160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-821c0030-afc3-4c02-be75-988d6f265b0f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:00.631363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-821c0030-afc3-4c02-be75-988d6f265b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:00.690272 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1395/2790] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:46:00.700046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437248df-46bf-43b4-b182-3ea480769a5f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:00.702268 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-437248df-46bf-43b4-b182-3ea480769a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:00.712969 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:00.761175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437248df-46bf-43b4-b182-3ea480769a5f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:00.765497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25137c10-e8b4-42e9-a97d-a916d18dc7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:00.766098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25137c10-e8b4-42e9-a97d-a916d18dc7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:00.766376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25137c10-e8b4-42e9-a97d-a916d18dc7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:00.766644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25137c10-e8b4-42e9-a97d-a916d18dc7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:00.775489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25137c10-e8b4-42e9-a97d-a916d18dc7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:00.776826 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25137c10-e8b4-42e9-a97d-a916d18dc7a7 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:00.786127 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1396/2791] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:01.404730 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3669d-6cdb-491c-a513-b3bdf8370b73 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:01.405017 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3669d-6cdb-491c-a513-b3bdf8370b73 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:01.405295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3669d-6cdb-491c-a513-b3bdf8370b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:01.433845 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-9dc3669d-6cdb-491c-a513-b3bdf8370b73 None None] MFA Rules not processed for user `c0d28fb10d5d4d37af1fc2f7333ee26b`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:01.435150 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-9dc3669d-6cdb-491c-a513-b3bdf8370b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:01.469166 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:01.508506 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1396/2792] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:01 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:01.512670 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25137c10-e8b4-42e9-a97d-a916d18dc7a7 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:01.522458 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25137c10-e8b4-42e9-a97d-a916d18dc7a7 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:01.526905 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5c496-b1ec-4bcf-8ce2-7e9f04a81f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:01.527570 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c496-b1ec-4bcf-8ce2-7e9f04a81f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:01.527850 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c496-b1ec-4bcf-8ce2-7e9f04a81f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:01.528115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5c496-b1ec-4bcf-8ce2-7e9f04a81f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:01.528766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5c496-b1ec-4bcf-8ce2-7e9f04a81f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:01.531179 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5c496-b1ec-4bcf-8ce2-7e9f04a81f06 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:01.562015 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1397/2793] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:01 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:01.565954 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3669d-6cdb-491c-a513-b3bdf8370b73 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:01.579843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3669d-6cdb-491c-a513-b3bdf8370b73 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:01.639840 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfbc29-8b7f-4df5-92b6-76169c830d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:01.640463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfbc29-8b7f-4df5-92b6-76169c830d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:01.640738 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfbc29-8b7f-4df5-92b6-76169c830d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:01.641004 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfbc29-8b7f-4df5-92b6-76169c830d49 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:01.641709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfbc29-8b7f-4df5-92b6-76169c830d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:01.643652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfbc29-8b7f-4df5-92b6-76169c830d49 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:01.669244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1397/2794] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:01 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:01.671113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5c496-b1ec-4bcf-8ce2-7e9f04a81f06 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:01.681974 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5c496-b1ec-4bcf-8ce2-7e9f04a81f06 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:01.687514 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301d7b2-f529-4aca-ba9d-1145d6038222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:01.688207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d7b2-f529-4aca-ba9d-1145d6038222 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:01.688492 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d7b2-f529-4aca-ba9d-1145d6038222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:01.688781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d7b2-f529-4aca-ba9d-1145d6038222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:01.689489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301d7b2-f529-4aca-ba9d-1145d6038222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:01.693009 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301d7b2-f529-4aca-ba9d-1145d6038222 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:01.702187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1398/2795] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 02:46:01.706382 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfbc29-8b7f-4df5-92b6-76169c830d49 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:01.717870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfbc29-8b7f-4df5-92b6-76169c830d49 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:01.722440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63251a9a-7047-482a-9b5f-95028a0def13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:01.723091 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63251a9a-7047-482a-9b5f-95028a0def13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:01.723368 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63251a9a-7047-482a-9b5f-95028a0def13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:01.723640 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63251a9a-7047-482a-9b5f-95028a0def13 admin admin] PATH_INFO: `/v3/projects/cae5bab4abb547678dcac4c32a7c77cc/users/d1fd71baeea546bca6917096ed35a7a2/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:01.738965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63251a9a-7047-482a-9b5f-95028a0def13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae5bab4abb547678dcac4c32a7c77cc, user_id=d1fd71baeea546bca6917096ed35a7a2, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:01.741631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63251a9a-7047-482a-9b5f-95028a0def13 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:01.754331 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1398/2796] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:01 2022] PUT /identity/v3/projects/cae5bab4abb547678dcac4c32a7c77cc/users/d1fd71baeea546bca6917096ed35a7a2/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:01.758181 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301d7b2-f529-4aca-ba9d-1145d6038222 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:01.767934 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301d7b2-f529-4aca-ba9d-1145d6038222 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:01.822725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0638a-d59c-4a32-a78b-0454ff7bc82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:01.823311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0638a-d59c-4a32-a78b-0454ff7bc82e admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:01.823585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0638a-d59c-4a32-a78b-0454ff7bc82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:01.823853 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0638a-d59c-4a32-a78b-0454ff7bc82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:01.824520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0638a-d59c-4a32-a78b-0454ff7bc82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:01.826186 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0638a-d59c-4a32-a78b-0454ff7bc82e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:01.835556 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1399/2797] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:01.839593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63251a9a-7047-482a-9b5f-95028a0def13 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:01.850110 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63251a9a-7047-482a-9b5f-95028a0def13 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:01.854617 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae196cf-d04c-4817-a6eb-2fc0cac544e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:01.855258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae196cf-d04c-4817-a6eb-2fc0cac544e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:01.855531 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae196cf-d04c-4817-a6eb-2fc0cac544e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:01.855798 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae196cf-d04c-4817-a6eb-2fc0cac544e4 admin admin] PATH_INFO: `/v3/projects/cae5bab4abb547678dcac4c32a7c77cc/users/d1fd71baeea546bca6917096ed35a7a2/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:01.858355 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae196cf-d04c-4817-a6eb-2fc0cac544e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae5bab4abb547678dcac4c32a7c77cc, user_id=d1fd71baeea546bca6917096ed35a7a2, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:01.860924 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae196cf-d04c-4817-a6eb-2fc0cac544e4 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:01.871243 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1399/2798] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:01 2022] PUT /identity/v3/projects/cae5bab4abb547678dcac4c32a7c77cc/users/d1fd71baeea546bca6917096ed35a7a2/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:02.486437 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8817e01-3b43-4885-8bfa-16bee29388cd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:02.486923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8817e01-3b43-4885-8bfa-16bee29388cd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:02.487187 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8817e01-3b43-4885-8bfa-16bee29388cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:02.517710 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b8817e01-3b43-4885-8bfa-16bee29388cd None None] MFA Rules not processed for user `d1fd71baeea546bca6917096ed35a7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:02.519021 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b8817e01-3b43-4885-8bfa-16bee29388cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:02.587226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:02.591248 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1400/2799] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:02 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:03.596569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae196cf-d04c-4817-a6eb-2fc0cac544e4 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:03.658476 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae196cf-d04c-4817-a6eb-2fc0cac544e4 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:03.662970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:03.663593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:03.663870 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:03.664140 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] PATH_INFO: `/v3/users/c0d28fb10d5d4d37af1fc2f7333ee26b` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:03.665302 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d28fb10d5d4d37af1fc2f7333ee26b)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:03.667225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:03.693983 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:03.714252 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d28fb10d5d4d37af1fc2f7333ee26b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:03.722059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d28fb10d5d4d37af1fc2f7333ee26b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:03.728879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d28fb10d5d4d37af1fc2f7333ee26b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:03.729530 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d28fb10d5d4d37af1fc2f7333ee26b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:03.742666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d28fb10d5d4d37af1fc2f7333ee26b'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:03.749988 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1400/2800] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:03 2022] DELETE /identity/v3/users/c0d28fb10d5d4d37af1fc2f7333ee26b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:03.917424 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8817e01-3b43-4885-8bfa-16bee29388cd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:03.929599 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8817e01-3b43-4885-8bfa-16bee29388cd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:03.992561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:03.993393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:03.993617 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:03.993885 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] PATH_INFO: `/v3/projects/03c5e778e0b8454a905fa071c5031f1a` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:03.995012 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c5e778e0b8454a905fa071c5031f1a)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:03.996894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:04.045534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c5e778e0b8454a905fa071c5031f1a', 'request_id': 'req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.052635 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c5e778e0b8454a905fa071c5031f1a', 'request_id': 'req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.058113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c5e778e0b8454a905fa071c5031f1a', 'request_id': 'req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.069275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] The token cache is being invalidate because project 03c5e778e0b8454a905fa071c5031f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:04.069585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.070225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.071711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1401/2801] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:03 2022] DELETE /identity/v3/projects/03c5e778e0b8454a905fa071c5031f1a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:04.075702 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:04.077782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:04.091242 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d245b-77c7-49b4-a6ed-cf66cfecc7bb admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:04.146879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:04.147505 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.147782 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.148052 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] PATH_INFO: `/v3/users/d1fd71baeea546bca6917096ed35a7a2` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.149196 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1fd71baeea546bca6917096ed35a7a2)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:04.151123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:04.196571 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1fd71baeea546bca6917096ed35a7a2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.203717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1fd71baeea546bca6917096ed35a7a2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.210716 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1fd71baeea546bca6917096ed35a7a2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.211361 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1fd71baeea546bca6917096ed35a7a2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.223153 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-a0a4145c-2948-4d96-a9e7-c9dfb6cd3a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1fd71baeea546bca6917096ed35a7a2'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.229200 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1401/2802] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:04 2022] DELETE /identity/v3/users/d1fd71baeea546bca6917096ed35a7a2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:04.405869 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:04.407312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:04.420558 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbd56-16cc-4bbf-bed4-8d118bfdb4b5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:04.477728 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:04.478361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.478643 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.478918 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] PATH_INFO: `/v3/projects/cae5bab4abb547678dcac4c32a7c77cc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.480052 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae5bab4abb547678dcac4c32a7c77cc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:04.481996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:04.517749 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:04.531199 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae5bab4abb547678dcac4c32a7c77cc', 'request_id': 'req-807871c8-d8b8-4643-9de4-88d7607d1982'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.538357 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae5bab4abb547678dcac4c32a7c77cc', 'request_id': 'req-807871c8-d8b8-4643-9de4-88d7607d1982'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.543960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae5bab4abb547678dcac4c32a7c77cc', 'request_id': 'req-807871c8-d8b8-4643-9de4-88d7607d1982'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.555496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] The token cache is being invalidate because project cae5bab4abb547678dcac4c32a7c77cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:04.555787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.556417 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-807871c8-d8b8-4643-9de4-88d7607d1982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:04.557964 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1402/2803] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:04 2022] DELETE /identity/v3/projects/cae5bab4abb547678dcac4c32a7c77cc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:04.562791 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec945-c89a-414c-ba03-94564dd10266 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.563077 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec945-c89a-414c-ba03-94564dd10266 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.563351 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec945-c89a-414c-ba03-94564dd10266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.582469 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-ddeec945-c89a-414c-ba03-94564dd10266 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:04.583656 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ddeec945-c89a-414c-ba03-94564dd10266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:04.600438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:04.644181 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1402/2804] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:04.653062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6e1e-494e-4ca3-b168-340b88b151e4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.653366 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6e1e-494e-4ca3-b168-340b88b151e4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.653647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc6e1e-494e-4ca3-b168-340b88b151e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.673731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-80dc6e1e-494e-4ca3-b168-340b88b151e4 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:04.674923 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-80dc6e1e-494e-4ca3-b168-340b88b151e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:04.682978 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1403/2805] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:46:04.687244 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec945-c89a-414c-ba03-94564dd10266 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:04.697434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec945-c89a-414c-ba03-94564dd10266 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:04.702029 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1d6a6-e555-4c5a-b7d3-7ae519e61bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:04.702635 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1d6a6-e555-4c5a-b7d3-7ae519e61bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.702915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1d6a6-e555-4c5a-b7d3-7ae519e61bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.703217 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1d6a6-e555-4c5a-b7d3-7ae519e61bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.703907 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1d6a6-e555-4c5a-b7d3-7ae519e61bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:46:04.704210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1d6a6-e555-4c5a-b7d3-7ae519e61bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:04.705829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1d6a6-e555-4c5a-b7d3-7ae519e61bf7 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:04.717795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1403/2806] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:46:04.722014 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc6e1e-494e-4ca3-b168-340b88b151e4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:04.731067 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc6e1e-494e-4ca3-b168-340b88b151e4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:04.736285 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1b5e-e954-4082-9392-e6f72801a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:04.736877 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1b5e-e954-4082-9392-e6f72801a7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.737154 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1b5e-e954-4082-9392-e6f72801a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.737731 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f1b5e-e954-4082-9392-e6f72801a7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.738393 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f1b5e-e954-4082-9392-e6f72801a7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:04.740256 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f1b5e-e954-4082-9392-e6f72801a7e5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:04.768093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1404/2807] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:04 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:46:04.772190 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1d6a6-e555-4c5a-b7d3-7ae519e61bf7 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:04.782649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1d6a6-e555-4c5a-b7d3-7ae519e61bf7 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:04.838882 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af8866-356e-4f71-8ae6-1f3a2f93c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:04.839468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af8866-356e-4f71-8ae6-1f3a2f93c12f admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.839747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af8866-356e-4f71-8ae6-1f3a2f93c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.840023 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af8866-356e-4f71-8ae6-1f3a2f93c12f admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.840671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af8866-356e-4f71-8ae6-1f3a2f93c12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:04.843120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af8866-356e-4f71-8ae6-1f3a2f93c12f admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:04.866671 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1404/2808] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:04 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:04.870808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1b5e-e954-4082-9392-e6f72801a7e5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:04.880975 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f1b5e-e954-4082-9392-e6f72801a7e5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:04.885497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe146d-2039-421c-b142-dee6a1f0c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:04.886120 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe146d-2039-421c-b142-dee6a1f0c71b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.886403 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe146d-2039-421c-b142-dee6a1f0c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.886677 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe146d-2039-421c-b142-dee6a1f0c71b admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.887356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe146d-2039-421c-b142-dee6a1f0c71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:04.889451 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe146d-2039-421c-b142-dee6a1f0c71b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:04.899399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1405/2809] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:04.903157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af8866-356e-4f71-8ae6-1f3a2f93c12f admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:04.913646 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af8866-356e-4f71-8ae6-1f3a2f93c12f admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:04.918207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91bfbd-e58a-4ee0-ab0b-b13c48cca46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:04.918796 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91bfbd-e58a-4ee0-ab0b-b13c48cca46a admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.919071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91bfbd-e58a-4ee0-ab0b-b13c48cca46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.919337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91bfbd-e58a-4ee0-ab0b-b13c48cca46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.920010 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91bfbd-e58a-4ee0-ab0b-b13c48cca46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:04.921587 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91bfbd-e58a-4ee0-ab0b-b13c48cca46a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:04.931903 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1405/2810] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:04.935894 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe146d-2039-421c-b142-dee6a1f0c71b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:04.945743 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe146d-2039-421c-b142-dee6a1f0c71b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:04.950293 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cbe82-3cae-4ce0-a8a9-614d92112fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:04.950931 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cbe82-3cae-4ce0-a8a9-614d92112fda admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.951698 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cbe82-3cae-4ce0-a8a9-614d92112fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.951966 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cbe82-3cae-4ce0-a8a9-614d92112fda admin admin] PATH_INFO: `/v3/projects/4da542a752104a0eb641366260bc2cc5/users/bf5ae69cc43e41818d51d823cd35f815/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:04.965988 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cbe82-3cae-4ce0-a8a9-614d92112fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da542a752104a0eb641366260bc2cc5, user_id=bf5ae69cc43e41818d51d823cd35f815, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:04.969226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cbe82-3cae-4ce0-a8a9-614d92112fda admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:04.981982 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1406/2811] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:04 2022] PUT /identity/v3/projects/4da542a752104a0eb641366260bc2cc5/users/bf5ae69cc43e41818d51d823cd35f815/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:04.992370 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354a468-2c83-41df-a344-3d6e8dc465d3 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:04.992653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354a468-2c83-41df-a344-3d6e8dc465d3 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:04.992925 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354a468-2c83-41df-a344-3d6e8dc465d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:05.019884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3354a468-2c83-41df-a344-3d6e8dc465d3 None None] MFA Rules not processed for user `bf5ae69cc43e41818d51d823cd35f815`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:05.021065 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3354a468-2c83-41df-a344-3d6e8dc465d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:05.082946 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1406/2812] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:05.087245 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cbe82-3cae-4ce0-a8a9-614d92112fda admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:05.146730 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cbe82-3cae-4ce0-a8a9-614d92112fda admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:05.151213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b65d-1eb3-43ec-97e2-84f1ba943841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:05.151801 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b65d-1eb3-43ec-97e2-84f1ba943841 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:05.152074 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b65d-1eb3-43ec-97e2-84f1ba943841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:05.152341 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b65d-1eb3-43ec-97e2-84f1ba943841 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:05.152989 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3b65d-1eb3-43ec-97e2-84f1ba943841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:05.155534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3b65d-1eb3-43ec-97e2-84f1ba943841 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:05.180531 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1407/2813] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:05 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:46:05.184667 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354a468-2c83-41df-a344-3d6e8dc465d3 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:05.195439 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354a468-2c83-41df-a344-3d6e8dc465d3 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:05.208360 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:05.253950 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ac5a5-f876-405d-b189-9f62b031213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:05.254564 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ac5a5-f876-405d-b189-9f62b031213e admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:05.254867 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ac5a5-f876-405d-b189-9f62b031213e admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:05.255138 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ac5a5-f876-405d-b189-9f62b031213e admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:05.255828 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ac5a5-f876-405d-b189-9f62b031213e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:05.257755 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ac5a5-f876-405d-b189-9f62b031213e admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:05.278747 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1407/2814] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:05 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:46:05.282769 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b65d-1eb3-43ec-97e2-84f1ba943841 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:05.293121 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b65d-1eb3-43ec-97e2-84f1ba943841 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:05.297711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f686-b513-4482-b0bd-aac91d41eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:05.298300 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f686-b513-4482-b0bd-aac91d41eb8b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:05.298578 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f686-b513-4482-b0bd-aac91d41eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:05.298847 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f686-b513-4482-b0bd-aac91d41eb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:05.299524 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141f686-b513-4482-b0bd-aac91d41eb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:05.301105 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141f686-b513-4482-b0bd-aac91d41eb8b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:05.311962 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1408/2815] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:05.315908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ac5a5-f876-405d-b189-9f62b031213e admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:05.325825 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ac5a5-f876-405d-b189-9f62b031213e admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:05.331003 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dd3e9-5c08-4d56-b1c6-07270ab080ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:05.331655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dd3e9-5c08-4d56-b1c6-07270ab080ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:05.331931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dd3e9-5c08-4d56-b1c6-07270ab080ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:05.332202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dd3e9-5c08-4d56-b1c6-07270ab080ab admin admin] PATH_INFO: `/v3/projects/cfa378b2571d41f2b3c3e704fbe7c033/users/901ca4ff89154353a052e2905e625694/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:05.346655 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dd3e9-5c08-4d56-b1c6-07270ab080ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa378b2571d41f2b3c3e704fbe7c033, user_id=901ca4ff89154353a052e2905e625694, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:05.349260 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dd3e9-5c08-4d56-b1c6-07270ab080ab admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:05.362083 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1408/2816] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:05 2022] PUT /identity/v3/projects/cfa378b2571d41f2b3c3e704fbe7c033/users/901ca4ff89154353a052e2905e625694/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:46:05.366374 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f686-b513-4482-b0bd-aac91d41eb8b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:05.376736 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f686-b513-4482-b0bd-aac91d41eb8b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:05.405647 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:05.434046 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1bc62-cb87-45dc-bd6b-6a5c9e125533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:05.434675 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1bc62-cb87-45dc-bd6b-6a5c9e125533 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:05.434951 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1bc62-cb87-45dc-bd6b-6a5c9e125533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:05.435221 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1bc62-cb87-45dc-bd6b-6a5c9e125533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:05.436384 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1bc62-cb87-45dc-bd6b-6a5c9e125533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:05.438048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1bc62-cb87-45dc-bd6b-6a5c9e125533 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:05.447515 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1409/2817] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:05.452267 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dd3e9-5c08-4d56-b1c6-07270ab080ab admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:05.463803 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dd3e9-5c08-4d56-b1c6-07270ab080ab admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:05.468572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc877e0-9da7-45d9-a834-b869064aff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:05.469225 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc877e0-9da7-45d9-a834-b869064aff26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:05.469569 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc877e0-9da7-45d9-a834-b869064aff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:05.469843 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc877e0-9da7-45d9-a834-b869064aff26 admin admin] PATH_INFO: `/v3/projects/cfa378b2571d41f2b3c3e704fbe7c033/users/901ca4ff89154353a052e2905e625694/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:05.471795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc877e0-9da7-45d9-a834-b869064aff26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa378b2571d41f2b3c3e704fbe7c033, user_id=901ca4ff89154353a052e2905e625694, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:05.474434 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc877e0-9da7-45d9-a834-b869064aff26 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:05.485594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1409/2818] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:05 2022] PUT /identity/v3/projects/cfa378b2571d41f2b3c3e704fbe7c033/users/901ca4ff89154353a052e2905e625694/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:05.495928 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5fb61-ee31-438c-82f5-cfb500cbd135 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:05.496213 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5fb61-ee31-438c-82f5-cfb500cbd135 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:05.496489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5fb61-ee31-438c-82f5-cfb500cbd135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:05.525217 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-adf5fb61-ee31-438c-82f5-cfb500cbd135 None None] MFA Rules not processed for user `901ca4ff89154353a052e2905e625694`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:05.526445 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-adf5fb61-ee31-438c-82f5-cfb500cbd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:05.593623 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1410/2819] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:05.604792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc877e0-9da7-45d9-a834-b869064aff26 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:05.606680 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-5cc877e0-9da7-45d9-a834-b869064aff26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:05.683436 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc877e0-9da7-45d9-a834-b869064aff26 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:05.687613 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7761ab-fd4b-42b8-a5b7-102c6558bbb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:05.688207 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7761ab-fd4b-42b8-a5b7-102c6558bbb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:05.688482 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7761ab-fd4b-42b8-a5b7-102c6558bbb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:05.688753 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7761ab-fd4b-42b8-a5b7-102c6558bbb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:05.743831 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7761ab-fd4b-42b8-a5b7-102c6558bbb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:05.745256 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7761ab-fd4b-42b8-a5b7-102c6558bbb2 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:05.754802 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1410/2820] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:07.099470 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5fb61-ee31-438c-82f5-cfb500cbd135 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:07.100904 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-adf5fb61-ee31-438c-82f5-cfb500cbd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:07.113668 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5fb61-ee31-438c-82f5-cfb500cbd135 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:07.117283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69b713-6196-42c6-81a0-594c990f6342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:07.117943 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69b713-6196-42c6-81a0-594c990f6342 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:07.118224 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69b713-6196-42c6-81a0-594c990f6342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:07.118490 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69b713-6196-42c6-81a0-594c990f6342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:07.127758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69b713-6196-42c6-81a0-594c990f6342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:07.129188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69b713-6196-42c6-81a0-594c990f6342 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:07.139173 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1411/2821] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:10.869375 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7761ab-fd4b-42b8-a5b7-102c6558bbb2 service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:10.874897 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:10.931600 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7761ab-fd4b-42b8-a5b7-102c6558bbb2 service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:10.936285 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:10.936959 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:10.937241 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:10.937554 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] PATH_INFO: `/v3/users/bf5ae69cc43e41818d51d823cd35f815` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:10.938711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5ae69cc43e41818d51d823cd35f815)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:10.940686 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:10.985725 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5ae69cc43e41818d51d823cd35f815'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:10.993295 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5ae69cc43e41818d51d823cd35f815'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.000188 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5ae69cc43e41818d51d823cd35f815'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.000822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5ae69cc43e41818d51d823cd35f815'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.012490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5ae69cc43e41818d51d823cd35f815'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.018728 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1411/2822] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:10 2022] DELETE /identity/v3/users/bf5ae69cc43e41818d51d823cd35f815 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:11.023253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c91ca-56c0-42f5-8f0f-abe18fd8294e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:11.023713 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c91ca-56c0-42f5-8f0f-abe18fd8294e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:11.023829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c91ca-56c0-42f5-8f0f-abe18fd8294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:11.042805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-832c91ca-56c0-42f5-8f0f-abe18fd8294e None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:11.043999 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-832c91ca-56c0-42f5-8f0f-abe18fd8294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:11.101829 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1412/2823] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:11.111341 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:11.112965 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:11.169410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89361f-6889-4b74-8aa1-6e3f029dc144 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:11.172996 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9aa9-7388-4dc5-80c9-7eef7aa69caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:11.173631 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9aa9-7388-4dc5-80c9-7eef7aa69caa service neutron] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:11.173910 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9aa9-7388-4dc5-80c9-7eef7aa69caa service neutron] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:11.174181 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9aa9-7388-4dc5-80c9-7eef7aa69caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:11.183098 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d9aa9-7388-4dc5-80c9-7eef7aa69caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:11.184546 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d9aa9-7388-4dc5-80c9-7eef7aa69caa service neutron] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:11.193875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1412/2824] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:11.458956 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c91ca-56c0-42f5-8f0f-abe18fd8294e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:11.460395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-832c91ca-56c0-42f5-8f0f-abe18fd8294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:11.472805 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c91ca-56c0-42f5-8f0f-abe18fd8294e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:11.478143 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:11.478796 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:11.479065 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:11.479337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] PATH_INFO: `/v3/projects/4da542a752104a0eb641366260bc2cc5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:11.480525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da542a752104a0eb641366260bc2cc5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:11.482559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:11.519808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:11.530362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da542a752104a0eb641366260bc2cc5', 'request_id': 'req-e66c8786-879b-41cf-ae53-4ba029925e1c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.537733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da542a752104a0eb641366260bc2cc5', 'request_id': 'req-e66c8786-879b-41cf-ae53-4ba029925e1c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.543275 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da542a752104a0eb641366260bc2cc5', 'request_id': 'req-e66c8786-879b-41cf-ae53-4ba029925e1c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.557661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] The token cache is being invalidate because project 4da542a752104a0eb641366260bc2cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:11.557944 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.558568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.560049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1413/2825] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:11 2022] DELETE /identity/v3/projects/4da542a752104a0eb641366260bc2cc5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:11.564601 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9aa9-7388-4dc5-80c9-7eef7aa69caa service neutron] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:11.574353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9aa9-7388-4dc5-80c9-7eef7aa69caa service neutron] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:11.599919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:11.634326 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:11.634884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:11.635163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:11.635438 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] PATH_INFO: `/v3/users/901ca4ff89154353a052e2905e625694` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:11.636576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=901ca4ff89154353a052e2905e625694)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:11.638510 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:11.682626 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901ca4ff89154353a052e2905e625694'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.690739 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901ca4ff89154353a052e2905e625694'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.697865 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901ca4ff89154353a052e2905e625694'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.698492 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901ca4ff89154353a052e2905e625694'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.710074 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-b453554e-8259-4057-95b7-abc7cbeabaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901ca4ff89154353a052e2905e625694'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:11.715915 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1413/2826] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:11 2022] DELETE /identity/v3/users/901ca4ff89154353a052e2905e625694 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:11.986720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:11.988407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:12.002192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c8786-879b-41cf-ae53-4ba029925e1c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.057965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.058600 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.058863 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.059135 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] PATH_INFO: `/v3/projects/cfa378b2571d41f2b3c3e704fbe7c033` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.060271 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa378b2571d41f2b3c3e704fbe7c033)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.062227 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.107391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa378b2571d41f2b3c3e704fbe7c033', 'request_id': 'req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:12.115126 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa378b2571d41f2b3c3e704fbe7c033', 'request_id': 'req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:12.120559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa378b2571d41f2b3c3e704fbe7c033', 'request_id': 'req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:12.131194 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] The token cache is being invalidate because project cfa378b2571d41f2b3c3e704fbe7c033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:12.131474 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:12.132108 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9c9b8f7b-9f97-4df2-bee3-264ece8876c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:12.133634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1414/2827] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:11 2022] DELETE /identity/v3/projects/cfa378b2571d41f2b3c3e704fbe7c033 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:12.138572 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f6ad-b253-4cef-9272-b846988442b8 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.139089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f6ad-b253-4cef-9272-b846988442b8 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.139203 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f6ad-b253-4cef-9272-b846988442b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.163722 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-8894f6ad-b253-4cef-9272-b846988442b8 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:12.164875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8894f6ad-b253-4cef-9272-b846988442b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:12.224214 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1414/2828] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:12.233737 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db6c4-74f8-4cf5-9207-a8d8e1565c3f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.234035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db6c4-74f8-4cf5-9207-a8d8e1565c3f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.234310 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db6c4-74f8-4cf5-9207-a8d8e1565c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.253733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f31db6c4-74f8-4cf5-9207-a8d8e1565c3f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:12.254930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f31db6c4-74f8-4cf5-9207-a8d8e1565c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:12.263031 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1415/2829] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:12.267143 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f6ad-b253-4cef-9272-b846988442b8 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.276779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f6ad-b253-4cef-9272-b846988442b8 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.281830 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6a8ed-6c0b-4465-9314-42990de13293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.282428 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6a8ed-6c0b-4465-9314-42990de13293 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.282708 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6a8ed-6c0b-4465-9314-42990de13293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.282981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6a8ed-6c0b-4465-9314-42990de13293 admin admin] PATH_INFO: `/v3/domains` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.283697 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6a8ed-6c0b-4465-9314-42990de13293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80480) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:46:12.283997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6a8ed-6c0b-4465-9314-42990de13293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.285605 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6a8ed-6c0b-4465-9314-42990de13293 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.297538 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1415/2830] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:46:12.301665 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31db6c4-74f8-4cf5-9207-a8d8e1565c3f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.311825 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31db6c4-74f8-4cf5-9207-a8d8e1565c3f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.316480 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157966e-7829-47c3-862c-bfc04573a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.317088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157966e-7829-47c3-862c-bfc04573a601 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.317395 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157966e-7829-47c3-862c-bfc04573a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.317669 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157966e-7829-47c3-862c-bfc04573a601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.318339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157966e-7829-47c3-862c-bfc04573a601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.320206 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157966e-7829-47c3-862c-bfc04573a601 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.347443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1416/2831] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:12 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:12.351588 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6a8ed-6c0b-4465-9314-42990de13293 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.362711 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6a8ed-6c0b-4465-9314-42990de13293 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.392054 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:12.421502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58533b-a74b-4d5b-ae6d-fc402d4eb293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.422066 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58533b-a74b-4d5b-ae6d-fc402d4eb293 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.422345 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58533b-a74b-4d5b-ae6d-fc402d4eb293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.422620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58533b-a74b-4d5b-ae6d-fc402d4eb293 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.423271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58533b-a74b-4d5b-ae6d-fc402d4eb293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.425163 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58533b-a74b-4d5b-ae6d-fc402d4eb293 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.447209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1416/2832] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:12 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:12.451327 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157966e-7829-47c3-862c-bfc04573a601 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.461991 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157966e-7829-47c3-862c-bfc04573a601 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.466583 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bd059-625a-407a-a2ec-36a1affb6067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.467178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bd059-625a-407a-a2ec-36a1affb6067 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.467456 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bd059-625a-407a-a2ec-36a1affb6067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.468405 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bd059-625a-407a-a2ec-36a1affb6067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.469087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bd059-625a-407a-a2ec-36a1affb6067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.470838 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bd059-625a-407a-a2ec-36a1affb6067 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.480611 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1417/2833] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:12.484507 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58533b-a74b-4d5b-ae6d-fc402d4eb293 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.494985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58533b-a74b-4d5b-ae6d-fc402d4eb293 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.499652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7eeb28-bf67-4e08-83c0-b66145af3bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.500253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eeb28-bf67-4e08-83c0-b66145af3bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.500534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eeb28-bf67-4e08-83c0-b66145af3bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.500810 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7eeb28-bf67-4e08-83c0-b66145af3bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.501525 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eeb28-bf67-4e08-83c0-b66145af3bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.503107 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7eeb28-bf67-4e08-83c0-b66145af3bd1 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.512989 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1417/2834] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:12.517529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bd059-625a-407a-a2ec-36a1affb6067 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.527365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bd059-625a-407a-a2ec-36a1affb6067 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.532525 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8a32-29d0-476a-bca7-30c345af3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.533168 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8a32-29d0-476a-bca7-30c345af3c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.533489 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8a32-29d0-476a-bca7-30c345af3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.533766 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8a32-29d0-476a-bca7-30c345af3c31 admin admin] PATH_INFO: `/v3/projects/1d5040a83e1d431987dc609d2250983a/users/bd42cbe15dc24f5cb929b83a42d442a1/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.544511 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:12.549145 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8a32-29d0-476a-bca7-30c345af3c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5040a83e1d431987dc609d2250983a, user_id=bd42cbe15dc24f5cb929b83a42d442a1, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.552240 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8a32-29d0-476a-bca7-30c345af3c31 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.565614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1418/2835] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:12 2022] PUT /identity/v3/projects/1d5040a83e1d431987dc609d2250983a/users/bd42cbe15dc24f5cb929b83a42d442a1/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:12.575894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52950a-3d92-42db-a0f3-d19fe577db01 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.576184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52950a-3d92-42db-a0f3-d19fe577db01 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.576464 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52950a-3d92-42db-a0f3-d19fe577db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.605176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-cd52950a-3d92-42db-a0f3-d19fe577db01 None None] MFA Rules not processed for user `bd42cbe15dc24f5cb929b83a42d442a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:12.606429 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-cd52950a-3d92-42db-a0f3-d19fe577db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:12.670350 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1418/2836] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:12.675418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8a32-29d0-476a-bca7-30c345af3c31 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.736447 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8a32-29d0-476a-bca7-30c345af3c31 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.741371 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642be6cd-4145-4e4e-8c8d-aca8be7092b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.741976 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be6cd-4145-4e4e-8c8d-aca8be7092b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.742257 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be6cd-4145-4e4e-8c8d-aca8be7092b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.742528 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be6cd-4145-4e4e-8c8d-aca8be7092b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.743184 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642be6cd-4145-4e4e-8c8d-aca8be7092b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.745090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642be6cd-4145-4e4e-8c8d-aca8be7092b1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.772025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1419/2837] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:12 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:12.777949 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52950a-3d92-42db-a0f3-d19fe577db01 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.789128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52950a-3d92-42db-a0f3-d19fe577db01 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.844735 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1644b48-1360-46f3-b42e-4d439b3c5c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.845367 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1644b48-1360-46f3-b42e-4d439b3c5c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.845650 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1644b48-1360-46f3-b42e-4d439b3c5c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.845923 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1644b48-1360-46f3-b42e-4d439b3c5c22 admin admin] PATH_INFO: `/v3/users` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.846576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1644b48-1360-46f3-b42e-4d439b3c5c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.848468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1644b48-1360-46f3-b42e-4d439b3c5c22 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.869129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1419/2838] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:12 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:12.873032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642be6cd-4145-4e4e-8c8d-aca8be7092b1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.883828 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642be6cd-4145-4e4e-8c8d-aca8be7092b1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.888367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cb3a4-85f9-427d-9d3f-1f7addb01559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.888959 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cb3a4-85f9-427d-9d3f-1f7addb01559 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.889279 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cb3a4-85f9-427d-9d3f-1f7addb01559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.890100 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cb3a4-85f9-427d-9d3f-1f7addb01559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.890778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cb3a4-85f9-427d-9d3f-1f7addb01559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.892346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cb3a4-85f9-427d-9d3f-1f7addb01559 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.903165 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1420/2839] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:12.907180 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1644b48-1360-46f3-b42e-4d439b3c5c22 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.917117 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1644b48-1360-46f3-b42e-4d439b3c5c22 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:12.921767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbabbe2-4796-48f4-8d4c-83b6995f60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:12.922413 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbabbe2-4796-48f4-8d4c-83b6995f60ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:12.922697 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbabbe2-4796-48f4-8d4c-83b6995f60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:12.922973 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbabbe2-4796-48f4-8d4c-83b6995f60ef admin admin] PATH_INFO: `/v3/projects/172049b27d904fbdb54b9fc9d8244cfa/users/2158813e02d5486c8ab1d35baf144826/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:12.937914 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbabbe2-4796-48f4-8d4c-83b6995f60ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=172049b27d904fbdb54b9fc9d8244cfa, user_id=2158813e02d5486c8ab1d35baf144826, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:12.940548 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbabbe2-4796-48f4-8d4c-83b6995f60ef admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:12.953767 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1420/2840] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:12 2022] PUT /identity/v3/projects/172049b27d904fbdb54b9fc9d8244cfa/users/2158813e02d5486c8ab1d35baf144826/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:12.957503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cb3a4-85f9-427d-9d3f-1f7addb01559 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:12.967307 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cb3a4-85f9-427d-9d3f-1f7addb01559 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:13.025144 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2b46d-2d5c-430b-a282-d81ba55bae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:13.025779 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2b46d-2d5c-430b-a282-d81ba55bae3b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:13.026062 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2b46d-2d5c-430b-a282-d81ba55bae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:13.026337 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2b46d-2d5c-430b-a282-d81ba55bae3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:13.027016 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2b46d-2d5c-430b-a282-d81ba55bae3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:13.028606 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2b46d-2d5c-430b-a282-d81ba55bae3b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:13.038197 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1421/2841] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:13.042280 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbabbe2-4796-48f4-8d4c-83b6995f60ef admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:13.052419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbabbe2-4796-48f4-8d4c-83b6995f60ef admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:13.056975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0523d7-5440-4104-8635-c1274b825720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:13.057660 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0523d7-5440-4104-8635-c1274b825720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:13.057944 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0523d7-5440-4104-8635-c1274b825720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:13.058221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0523d7-5440-4104-8635-c1274b825720 admin admin] PATH_INFO: `/v3/projects/172049b27d904fbdb54b9fc9d8244cfa/users/2158813e02d5486c8ab1d35baf144826/roles/999cac3070e64b82b981258349005963` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:13.060172 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0523d7-5440-4104-8635-c1274b825720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172049b27d904fbdb54b9fc9d8244cfa, user_id=2158813e02d5486c8ab1d35baf144826, role_id=999cac3070e64b82b981258349005963)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:13.063363 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0523d7-5440-4104-8635-c1274b825720 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:13.065552 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:13.075317 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1421/2842] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:13 2022] PUT /identity/v3/projects/172049b27d904fbdb54b9fc9d8244cfa/users/2158813e02d5486c8ab1d35baf144826/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:13.086726 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f77b-e82b-4239-87de-0c1e2b5cbffe None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:13.087219 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f77b-e82b-4239-87de-0c1e2b5cbffe None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:13.087324 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35f77b-e82b-4239-87de-0c1e2b5cbffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:13.114674 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3b35f77b-e82b-4239-87de-0c1e2b5cbffe None None] MFA Rules not processed for user `2158813e02d5486c8ab1d35baf144826`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:13.115854 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3b35f77b-e82b-4239-87de-0c1e2b5cbffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:13.160329 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:13.181770 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1422/2843] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:13.194253 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0523d7-5440-4104-8635-c1274b825720 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:13.195994 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-2f0523d7-5440-4104-8635-c1274b825720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:13.253452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0523d7-5440-4104-8635-c1274b825720 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:13.257028 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1607c-ef78-4199-8aaa-96406d3dcfde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:13.257663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1607c-ef78-4199-8aaa-96406d3dcfde service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:13.257940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1607c-ef78-4199-8aaa-96406d3dcfde service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:13.258210 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1607c-ef78-4199-8aaa-96406d3dcfde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:13.267270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1607c-ef78-4199-8aaa-96406d3dcfde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:13.268709 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1607c-ef78-4199-8aaa-96406d3dcfde service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:13.278069 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1422/2844] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:13.577376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35f77b-e82b-4239-87de-0c1e2b5cbffe None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:13.586541 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35f77b-e82b-4239-87de-0c1e2b5cbffe None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:13.591156 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b80f4-4cde-443c-a89e-a7c06e321b2c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2158813e02d5486c8ab1d35baf144826', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '172049b27d904fbdb54b9fc9d8244cfa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:13.591799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b80f4-4cde-443c-a89e-a7c06e321b2c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:13.592080 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b80f4-4cde-443c-a89e-a7c06e321b2c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:13.592851 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b80f4-4cde-443c-a89e-a7c06e321b2c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:13.593585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b80f4-4cde-443c-a89e-a7c06e321b2c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:46:13.593888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b80f4-4cde-443c-a89e-a7c06e321b2c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:13.595662 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b80f4-4cde-443c-a89e-a7c06e321b2c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:13.609424 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1423/2845] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:46:13.671398 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1607c-ef78-4199-8aaa-96406d3dcfde service cinder] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:13.681157 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1607c-ef78-4199-8aaa-96406d3dcfde service cinder] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:13.685919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c56520-a3b9-4860-82aa-98610364a61c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2158813e02d5486c8ab1d35baf144826', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '172049b27d904fbdb54b9fc9d8244cfa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:13.686598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56520-a3b9-4860-82aa-98610364a61c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:13.686883 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56520-a3b9-4860-82aa-98610364a61c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:13.687162 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56520-a3b9-4860-82aa-98610364a61c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:13.687879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c56520-a3b9-4860-82aa-98610364a61c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:13.689844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c56520-a3b9-4860-82aa-98610364a61c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:13.722037 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1423/2846] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:13 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:13.723534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b80f4-4cde-443c-a89e-a7c06e321b2c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:13.735101 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b80f4-4cde-443c-a89e-a7c06e321b2c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:13.791116 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2158813e02d5486c8ab1d35baf144826', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '172049b27d904fbdb54b9fc9d8244cfa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:13.791645 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:13.791929 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:13.792205 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:13.792889 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:46:13.793192 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:13.794835 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:13.807316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1424/2847] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:46:13.843387 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c56520-a3b9-4860-82aa-98610364a61c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:13.853539 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c56520-a3b9-4860-82aa-98610364a61c tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:13.858727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2158813e02d5486c8ab1d35baf144826', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '172049b27d904fbdb54b9fc9d8244cfa', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:13.859392 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:13.859675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:13.859947 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] PATH_INFO: `/v3/projects/7f4b37c90a3b417a9fca79b98dd95c8c` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:13.861108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7f4b37c90a3b417a9fca79b98dd95c8c)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:13.863321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:13.910633 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4b37c90a3b417a9fca79b98dd95c8c', 'request_id': 'req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.918213 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4b37c90a3b417a9fca79b98dd95c8c', 'request_id': 'req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.924038 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4b37c90a3b417a9fca79b98dd95c8c', 'request_id': 'req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.935160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] The token cache is being invalidate because project 7f4b37c90a3b417a9fca79b98dd95c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:13.935440 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.936060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f4f07b07-1bf0-4bb4-a446-402bf880f0eb tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:13.937653 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1424/2848] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:13 2022] DELETE /identity/v3/projects/7f4b37c90a3b417a9fca79b98dd95c8c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:14.127025 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:14.128775 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:14.192225 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895698a-2e47-44cc-8951-b1cd9762277d tempest-VolumeQuotaClassesTest-1911545713 tempest-VolumeQuotaClassesTest-1911545713-project-admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:14.249113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:14.249772 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:14.250049 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:14.250325 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] PATH_INFO: `/v3/users/bd42cbe15dc24f5cb929b83a42d442a1` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:14.251481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd42cbe15dc24f5cb929b83a42d442a1)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:14.253442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:14.266781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:14.298906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd42cbe15dc24f5cb929b83a42d442a1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.305930 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd42cbe15dc24f5cb929b83a42d442a1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.313276 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd42cbe15dc24f5cb929b83a42d442a1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.313992 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd42cbe15dc24f5cb929b83a42d442a1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.314616 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd42cbe15dc24f5cb929b83a42d442a1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.332496 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1425/2849] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:14 2022] DELETE /identity/v3/users/bd42cbe15dc24f5cb929b83a42d442a1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:14.336931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b6980-140e-4b13-88d3-4b75b14430f1 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:14.337422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b6980-140e-4b13-88d3-4b75b14430f1 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:14.337521 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b6980-140e-4b13-88d3-4b75b14430f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:14.355783 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-439b6980-140e-4b13-88d3-4b75b14430f1 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:14.356980 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-439b6980-140e-4b13-88d3-4b75b14430f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:14.406550 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:14.417713 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1425/2850] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:14.427462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:14.428916 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:14.485261 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8855245-9444-4fe3-872b-a56622349b69 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:14.489115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89c3f-8087-45d1-94de-60c331a02c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:14.489751 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89c3f-8087-45d1-94de-60c331a02c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:14.490033 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89c3f-8087-45d1-94de-60c331a02c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:14.490309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89c3f-8087-45d1-94de-60c331a02c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:14.499673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd89c3f-8087-45d1-94de-60c331a02c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:14.501088 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd89c3f-8087-45d1-94de-60c331a02c68 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:14.510516 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1426/2851] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:14.776520 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b6980-140e-4b13-88d3-4b75b14430f1 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:14.777997 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-439b6980-140e-4b13-88d3-4b75b14430f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:14.790059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b6980-140e-4b13-88d3-4b75b14430f1 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:14.797544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:14.798160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:14.798456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:14.798727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] PATH_INFO: `/v3/projects/1d5040a83e1d431987dc609d2250983a` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:14.800000 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5040a83e1d431987dc609d2250983a)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:14.801951 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:14.849663 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5040a83e1d431987dc609d2250983a', 'request_id': 'req-86771605-9cc6-48cb-8b8b-b4e413b0193a'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.856675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5040a83e1d431987dc609d2250983a', 'request_id': 'req-86771605-9cc6-48cb-8b8b-b4e413b0193a'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.863079 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5040a83e1d431987dc609d2250983a', 'request_id': 'req-86771605-9cc6-48cb-8b8b-b4e413b0193a'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.874887 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] The token cache is being invalidate because project 1d5040a83e1d431987dc609d2250983a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:14.875175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.875788 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:14.877444 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1426/2852] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:14 2022] DELETE /identity/v3/projects/1d5040a83e1d431987dc609d2250983a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:14.881351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89c3f-8087-45d1-94de-60c331a02c68 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:14.890926 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89c3f-8087-45d1-94de-60c331a02c68 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:14.945466 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:14.946090 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:14.946365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:14.946633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] PATH_INFO: `/v3/users/2158813e02d5486c8ab1d35baf144826` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:14.947764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2158813e02d5486c8ab1d35baf144826)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:14.949704 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:14.985845 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:14.995510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2158813e02d5486c8ab1d35baf144826'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.002946 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2158813e02d5486c8ab1d35baf144826'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.009800 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2158813e02d5486c8ab1d35baf144826'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.010411 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2158813e02d5486c8ab1d35baf144826'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.011001 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a6e2bc2-dadd-4b7f-a5a0-d5629ca06c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2158813e02d5486c8ab1d35baf144826'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.027740 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1427/2853] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:14 2022] DELETE /identity/v3/users/2158813e02d5486c8ab1d35baf144826 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:15.295557 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:15.297964 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:15.311282 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86771605-9cc6-48cb-8b8b-b4e413b0193a admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:15.368294 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:15.368931 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.369189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.369508 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] PATH_INFO: `/v3/projects/172049b27d904fbdb54b9fc9d8244cfa` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.370652 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=172049b27d904fbdb54b9fc9d8244cfa)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:15.372591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:15.417829 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172049b27d904fbdb54b9fc9d8244cfa', 'request_id': 'req-f56fbd62-7cd6-4b27-b793-79896c9e6afb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.424966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172049b27d904fbdb54b9fc9d8244cfa', 'request_id': 'req-f56fbd62-7cd6-4b27-b793-79896c9e6afb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.430490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172049b27d904fbdb54b9fc9d8244cfa', 'request_id': 'req-f56fbd62-7cd6-4b27-b793-79896c9e6afb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.441186 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] The token cache is being invalidate because project 172049b27d904fbdb54b9fc9d8244cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:15.441502 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.442126 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-f56fbd62-7cd6-4b27-b793-79896c9e6afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:15.443629 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1427/2854] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:15 2022] DELETE /identity/v3/projects/172049b27d904fbdb54b9fc9d8244cfa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:15.448593 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98bca9-453b-44d6-983d-78a67498c567 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.449092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98bca9-453b-44d6-983d-78a67498c567 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.449273 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98bca9-453b-44d6-983d-78a67498c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.469122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-fa98bca9-453b-44d6-983d-78a67498c567 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:15.470342 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fa98bca9-453b-44d6-983d-78a67498c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:15.529296 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1428/2855] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:15.537594 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4da7-22f9-4d33-8646-6a5b027cede5 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.537884 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4da7-22f9-4d33-8646-6a5b027cede5 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.538164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a4da7-22f9-4d33-8646-6a5b027cede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.557901 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-306a4da7-22f9-4d33-8646-6a5b027cede5 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:15.559105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-306a4da7-22f9-4d33-8646-6a5b027cede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:15.567120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1428/2856] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:15.571398 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98bca9-453b-44d6-983d-78a67498c567 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:15.581892 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98bca9-453b-44d6-983d-78a67498c567 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:15.586383 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca69ce-a64e-4007-93a8-8d34787c5d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:15.586985 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca69ce-a64e-4007-93a8-8d34787c5d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.587260 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca69ce-a64e-4007-93a8-8d34787c5d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.587529 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca69ce-a64e-4007-93a8-8d34787c5d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.588207 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca69ce-a64e-4007-93a8-8d34787c5d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:46:15.588534 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca69ce-a64e-4007-93a8-8d34787c5d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:15.590153 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca69ce-a64e-4007-93a8-8d34787c5d26 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:15.602316 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1429/2857] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:46:15.606696 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4da7-22f9-4d33-8646-6a5b027cede5 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:15.612669 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:15.616416 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a4da7-22f9-4d33-8646-6a5b027cede5 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:15.622013 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac19063-bd1b-46d1-a77e-b2a1ef621e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:15.622823 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac19063-bd1b-46d1-a77e-b2a1ef621e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.623301 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac19063-bd1b-46d1-a77e-b2a1ef621e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.623775 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac19063-bd1b-46d1-a77e-b2a1ef621e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.624453 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac19063-bd1b-46d1-a77e-b2a1ef621e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:15.626447 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac19063-bd1b-46d1-a77e-b2a1ef621e65 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:15.652938 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1429/2858] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:15 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:15.657661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca69ce-a64e-4007-93a8-8d34787c5d26 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:15.667518 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca69ce-a64e-4007-93a8-8d34787c5d26 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:15.722765 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee3c3b-195a-4fef-a14a-5a0ce833443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:15.723365 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee3c3b-195a-4fef-a14a-5a0ce833443d admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.723642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee3c3b-195a-4fef-a14a-5a0ce833443d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.723909 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee3c3b-195a-4fef-a14a-5a0ce833443d admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.724559 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee3c3b-195a-4fef-a14a-5a0ce833443d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:15.726473 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee3c3b-195a-4fef-a14a-5a0ce833443d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:15.747997 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1430/2859] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:15 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:15.752727 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac19063-bd1b-46d1-a77e-b2a1ef621e65 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:15.763466 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac19063-bd1b-46d1-a77e-b2a1ef621e65 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:15.768634 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312cb2c-e0f9-41fc-ac68-c80e407f4042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:15.769271 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312cb2c-e0f9-41fc-ac68-c80e407f4042 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.769583 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312cb2c-e0f9-41fc-ac68-c80e407f4042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.769880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312cb2c-e0f9-41fc-ac68-c80e407f4042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.770576 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312cb2c-e0f9-41fc-ac68-c80e407f4042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:15.772161 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312cb2c-e0f9-41fc-ac68-c80e407f4042 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:15.782159 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1430/2860] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:15.785979 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee3c3b-195a-4fef-a14a-5a0ce833443d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:15.795901 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee3c3b-195a-4fef-a14a-5a0ce833443d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:15.800554 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f608b1-46ed-4a81-8736-32a2ecba6f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:15.801148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f608b1-46ed-4a81-8736-32a2ecba6f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.801460 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f608b1-46ed-4a81-8736-32a2ecba6f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.801758 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f608b1-46ed-4a81-8736-32a2ecba6f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.802651 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f608b1-46ed-4a81-8736-32a2ecba6f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:15.804420 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f608b1-46ed-4a81-8736-32a2ecba6f80 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:15.815568 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1431/2861] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:15.820022 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312cb2c-e0f9-41fc-ac68-c80e407f4042 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:15.830495 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312cb2c-e0f9-41fc-ac68-c80e407f4042 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:15.835056 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5880b-cbf5-463e-9328-669f6811dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:15.835698 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5880b-cbf5-463e-9328-669f6811dfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.835975 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5880b-cbf5-463e-9328-669f6811dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.836247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5880b-cbf5-463e-9328-669f6811dfdb admin admin] PATH_INFO: `/v3/projects/dfb6421f449544afa8ac83a01e6ce837/users/6003b2b64256451a9bd0bab232937012/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.850425 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5880b-cbf5-463e-9328-669f6811dfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb6421f449544afa8ac83a01e6ce837, user_id=6003b2b64256451a9bd0bab232937012, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:15.853025 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5880b-cbf5-463e-9328-669f6811dfdb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:15.865844 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1431/2862] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:15 2022] PUT /identity/v3/projects/dfb6421f449544afa8ac83a01e6ce837/users/6003b2b64256451a9bd0bab232937012/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:46:15.876057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f343a84-23b5-445f-92af-6118f0fe84e6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:15.876286 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f343a84-23b5-445f-92af-6118f0fe84e6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:15.876585 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f343a84-23b5-445f-92af-6118f0fe84e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:15.904399 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1f343a84-23b5-445f-92af-6118f0fe84e6 None None] MFA Rules not processed for user `6003b2b64256451a9bd0bab232937012`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:15.905926 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1f343a84-23b5-445f-92af-6118f0fe84e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:15.913870 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:15.971563 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1432/2863] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:15.975935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5880b-cbf5-463e-9328-669f6811dfdb admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:16.036128 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5880b-cbf5-463e-9328-669f6811dfdb admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:16.040787 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5989-aa04-439e-b7e2-8fa1ba23047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:16.041410 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5989-aa04-439e-b7e2-8fa1ba23047b admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:16.041692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5989-aa04-439e-b7e2-8fa1ba23047b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:16.041970 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b5989-aa04-439e-b7e2-8fa1ba23047b admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:16.042619 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b5989-aa04-439e-b7e2-8fa1ba23047b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:16.044493 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b5989-aa04-439e-b7e2-8fa1ba23047b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:16.070337 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1432/2864] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:15 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:16.074339 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f343a84-23b5-445f-92af-6118f0fe84e6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:16.085495 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f343a84-23b5-445f-92af-6118f0fe84e6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:16.141351 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51fb0b-cc71-4b8f-a83b-6beb321964de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:16.141897 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51fb0b-cc71-4b8f-a83b-6beb321964de admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:16.142175 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51fb0b-cc71-4b8f-a83b-6beb321964de admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:16.142447 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51fb0b-cc71-4b8f-a83b-6beb321964de admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:16.143094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51fb0b-cc71-4b8f-a83b-6beb321964de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:16.144998 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51fb0b-cc71-4b8f-a83b-6beb321964de admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:16.165297 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1433/2865] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:16 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:16.169247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5989-aa04-439e-b7e2-8fa1ba23047b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:16.180123 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b5989-aa04-439e-b7e2-8fa1ba23047b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:16.184744 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8e2e-c61a-4789-9f4a-8333f9a74b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:16.185385 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8e2e-c61a-4789-9f4a-8333f9a74b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:16.185666 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8e2e-c61a-4789-9f4a-8333f9a74b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:16.185935 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8e2e-c61a-4789-9f4a-8333f9a74b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:16.187221 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8e2e-c61a-4789-9f4a-8333f9a74b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:16.188795 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8e2e-c61a-4789-9f4a-8333f9a74b1b admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:16.199181 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1433/2866] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:16.203032 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51fb0b-cc71-4b8f-a83b-6beb321964de admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:16.214226 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51fb0b-cc71-4b8f-a83b-6beb321964de admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:16.218876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa9d9-f06f-4493-a129-42d45dd81b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:16.219527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa9d9-f06f-4493-a129-42d45dd81b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:16.219809 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa9d9-f06f-4493-a129-42d45dd81b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:16.220087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa9d9-f06f-4493-a129-42d45dd81b09 admin admin] PATH_INFO: `/v3/projects/262761eb58b740039194d449ab49a46c/users/3c8e72321e394216ade142d62104d12f/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:16.235139 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aa9d9-f06f-4493-a129-42d45dd81b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262761eb58b740039194d449ab49a46c, user_id=3c8e72321e394216ade142d62104d12f, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:16.238087 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aa9d9-f06f-4493-a129-42d45dd81b09 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:16.250855 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1434/2867] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:16 2022] PUT /identity/v3/projects/262761eb58b740039194d449ab49a46c/users/3c8e72321e394216ade142d62104d12f/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:16.254658 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8e2e-c61a-4789-9f4a-8333f9a74b1b admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:16.264675 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8e2e-c61a-4789-9f4a-8333f9a74b1b admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:16.321189 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be03a5-6401-40f2-9042-132dd1998dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:16.321824 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be03a5-6401-40f2-9042-132dd1998dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:16.322105 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be03a5-6401-40f2-9042-132dd1998dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:16.322383 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be03a5-6401-40f2-9042-132dd1998dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:16.323064 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be03a5-6401-40f2-9042-132dd1998dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:16.324636 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be03a5-6401-40f2-9042-132dd1998dd5 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:16.334321 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1434/2868] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:16.338391 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa9d9-f06f-4493-a129-42d45dd81b09 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:16.348605 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa9d9-f06f-4493-a129-42d45dd81b09 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:16.353141 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67aa01-185c-4e83-98ec-1bd652f4f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:16.353818 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67aa01-185c-4e83-98ec-1bd652f4f5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:16.354094 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67aa01-185c-4e83-98ec-1bd652f4f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:16.354362 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67aa01-185c-4e83-98ec-1bd652f4f5fd admin admin] PATH_INFO: `/v3/projects/262761eb58b740039194d449ab49a46c/users/3c8e72321e394216ade142d62104d12f/roles/999cac3070e64b82b981258349005963` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:16.356265 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67aa01-185c-4e83-98ec-1bd652f4f5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=262761eb58b740039194d449ab49a46c, user_id=3c8e72321e394216ade142d62104d12f, role_id=999cac3070e64b82b981258349005963)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:16.359377 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67aa01-185c-4e83-98ec-1bd652f4f5fd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:16.369527 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1435/2869] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:16 2022] PUT /identity/v3/projects/262761eb58b740039194d449ab49a46c/users/3c8e72321e394216ade142d62104d12f/roles/999cac3070e64b82b981258349005963 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 02:46:16.381284 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8716c2-0376-4199-a462-1bc54c5f9855 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:16.381779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8716c2-0376-4199-a462-1bc54c5f9855 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:16.381898 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8716c2-0376-4199-a462-1bc54c5f9855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:16.409894 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-df8716c2-0376-4199-a462-1bc54c5f9855 None None] MFA Rules not processed for user `3c8e72321e394216ade142d62104d12f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:16.411042 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-df8716c2-0376-4199-a462-1bc54c5f9855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:16.416035 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:16.479071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1435/2870] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:46:16.491787 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67aa01-185c-4e83-98ec-1bd652f4f5fd admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:16.493612 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9a67aa01-185c-4e83-98ec-1bd652f4f5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:16.550228 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67aa01-185c-4e83-98ec-1bd652f4f5fd admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:16.553898 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87de2f7-9ae5-4ec5-9ed5-7166d064e05e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:16.554503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87de2f7-9ae5-4ec5-9ed5-7166d064e05e service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:16.554784 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87de2f7-9ae5-4ec5-9ed5-7166d064e05e service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:16.555057 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87de2f7-9ae5-4ec5-9ed5-7166d064e05e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:16.564422 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87de2f7-9ae5-4ec5-9ed5-7166d064e05e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:16.565888 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87de2f7-9ae5-4ec5-9ed5-7166d064e05e service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:16.575462 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1436/2871] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:16.647886 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8716c2-0376-4199-a462-1bc54c5f9855 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:16.658045 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8716c2-0376-4199-a462-1bc54c5f9855 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:16.661670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe7568-9007-44f6-b5e0-53e5c3ea4306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:16.662212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe7568-9007-44f6-b5e0-53e5c3ea4306 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:16.662486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe7568-9007-44f6-b5e0-53e5c3ea4306 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:16.662756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe7568-9007-44f6-b5e0-53e5c3ea4306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:16.718087 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe7568-9007-44f6-b5e0-53e5c3ea4306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:16.719490 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe7568-9007-44f6-b5e0-53e5c3ea4306 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:16.728169 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1436/2872] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:16.990848 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87de2f7-9ae5-4ec5-9ed5-7166d064e05e service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:16.996092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:17.052561 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87de2f7-9ae5-4ec5-9ed5-7166d064e05e service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:17.057070 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:17.057720 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:17.058000 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:17.058272 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] PATH_INFO: `/v3/users/6003b2b64256451a9bd0bab232937012` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:17.059406 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6003b2b64256451a9bd0bab232937012)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:17.061356 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:17.106533 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6003b2b64256451a9bd0bab232937012'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.113861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6003b2b64256451a9bd0bab232937012'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.121048 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6003b2b64256451a9bd0bab232937012'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.121718 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6003b2b64256451a9bd0bab232937012'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.122320 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6003b2b64256451a9bd0bab232937012'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.139752 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1437/2873] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:16 2022] DELETE /identity/v3/users/6003b2b64256451a9bd0bab232937012 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:17.144175 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72398-8006-4044-8193-725ab087bac7 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:17.144463 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72398-8006-4044-8193-725ab087bac7 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:17.144737 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72398-8006-4044-8193-725ab087bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:17.164258 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-6ae72398-8006-4044-8193-725ab087bac7 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:17.165414 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6ae72398-8006-4044-8193-725ab087bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:17.223075 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1437/2874] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:46:17.232634 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:17.234673 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:17.291655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ee0a-883f-44bd-b0a5-6738216ccb5b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:17.295229 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eae6c5-9f70-47df-97bb-3b0c6601de99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:17.295827 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eae6c5-9f70-47df-97bb-3b0c6601de99 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:17.296102 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eae6c5-9f70-47df-97bb-3b0c6601de99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:17.296372 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eae6c5-9f70-47df-97bb-3b0c6601de99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:17.305291 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eae6c5-9f70-47df-97bb-3b0c6601de99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:17.306724 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eae6c5-9f70-47df-97bb-3b0c6601de99 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:17.316503 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1438/2875] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:17.581276 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72398-8006-4044-8193-725ab087bac7 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:17.583212 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-6ae72398-8006-4044-8193-725ab087bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:17.596096 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72398-8006-4044-8193-725ab087bac7 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:17.600908 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:17.601644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:17.601966 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:17.602165 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] PATH_INFO: `/v3/projects/dfb6421f449544afa8ac83a01e6ce837` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:17.603312 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb6421f449544afa8ac83a01e6ce837)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:17.605220 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:17.644184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:17.654449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb6421f449544afa8ac83a01e6ce837', 'request_id': 'req-8d970913-ae5e-4130-b991-0de21ba27c42'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.661979 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb6421f449544afa8ac83a01e6ce837', 'request_id': 'req-8d970913-ae5e-4130-b991-0de21ba27c42'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.667608 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb6421f449544afa8ac83a01e6ce837', 'request_id': 'req-8d970913-ae5e-4130-b991-0de21ba27c42'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.678526 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] The token cache is being invalidate because project dfb6421f449544afa8ac83a01e6ce837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:17.678815 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.679452 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.681015 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1438/2876] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:17 2022] DELETE /identity/v3/projects/dfb6421f449544afa8ac83a01e6ce837 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:17.684936 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eae6c5-9f70-47df-97bb-3b0c6601de99 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:17.694387 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eae6c5-9f70-47df-97bb-3b0c6601de99 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:17.718637 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:17.753311 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:17.753965 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:17.754248 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:17.754522 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] PATH_INFO: `/v3/users/3c8e72321e394216ade142d62104d12f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:17.755661 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8e72321e394216ade142d62104d12f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:17.757632 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:17.802312 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8e72321e394216ade142d62104d12f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.809469 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8e72321e394216ade142d62104d12f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.816340 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8e72321e394216ade142d62104d12f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.816954 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8e72321e394216ade142d62104d12f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.817626 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-08dcf89a-9281-4504-a159-e24f2c7e4ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8e72321e394216ade142d62104d12f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:17.834725 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1439/2877] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:17 2022] DELETE /identity/v3/users/3c8e72321e394216ade142d62104d12f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:18.103929 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:18.105417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:18.118426 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d970913-ae5e-4130-b991-0de21ba27c42 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:18.175659 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:18.176291 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.176573 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.176848 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] PATH_INFO: `/v3/projects/262761eb58b740039194d449ab49a46c` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.178021 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=262761eb58b740039194d449ab49a46c)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:18.179919 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:18.225060 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262761eb58b740039194d449ab49a46c', 'request_id': 'req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:18.233047 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262761eb58b740039194d449ab49a46c', 'request_id': 'req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:18.238861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262761eb58b740039194d449ab49a46c', 'request_id': 'req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:18.250229 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] The token cache is being invalidate because project 262761eb58b740039194d449ab49a46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:18.250509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:18.251120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-4b50e9ca-f3a2-4ba0-b53f-140d866255eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:18.252591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1439/2878] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:18 2022] DELETE /identity/v3/projects/262761eb58b740039194d449ab49a46c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:18.257871 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a734dd-1fc0-40c8-959e-2a5ec7d07dbd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.258178 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a734dd-1fc0-40c8-959e-2a5ec7d07dbd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.258443 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a734dd-1fc0-40c8-959e-2a5ec7d07dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.278035 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-13a734dd-1fc0-40c8-959e-2a5ec7d07dbd None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:18.279215 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-13a734dd-1fc0-40c8-959e-2a5ec7d07dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:18.336421 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1440/2879] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:18.344310 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64fb89-47cc-485e-b14a-519cbae5525f None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.344591 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64fb89-47cc-485e-b14a-519cbae5525f None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.344864 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64fb89-47cc-485e-b14a-519cbae5525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.364672 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3c64fb89-47cc-485e-b14a-519cbae5525f None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:18.365889 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3c64fb89-47cc-485e-b14a-519cbae5525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:18.374184 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1440/2880] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:18.378388 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a734dd-1fc0-40c8-959e-2a5ec7d07dbd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:18.388277 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a734dd-1fc0-40c8-959e-2a5ec7d07dbd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:18.392734 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49623192-5293-4596-bf3a-3799d44cf7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:18.393346 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623192-5293-4596-bf3a-3799d44cf7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.393655 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623192-5293-4596-bf3a-3799d44cf7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.393925 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623192-5293-4596-bf3a-3799d44cf7d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.394657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49623192-5293-4596-bf3a-3799d44cf7d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:46:18.394996 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49623192-5293-4596-bf3a-3799d44cf7d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:18.396876 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49623192-5293-4596-bf3a-3799d44cf7d3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:18.408646 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1441/2881] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:46:18.412814 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64fb89-47cc-485e-b14a-519cbae5525f None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:18.422516 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64fb89-47cc-485e-b14a-519cbae5525f None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:18.427106 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd5c7a-09b0-4945-80f4-a1c0115166d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:18.427700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd5c7a-09b0-4945-80f4-a1c0115166d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.427977 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd5c7a-09b0-4945-80f4-a1c0115166d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.428247 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd5c7a-09b0-4945-80f4-a1c0115166d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.428904 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd5c7a-09b0-4945-80f4-a1c0115166d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:18.430792 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd5c7a-09b0-4945-80f4-a1c0115166d7 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:18.457993 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1441/2882] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:18 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:18.462148 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49623192-5293-4596-bf3a-3799d44cf7d3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:18.471940 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49623192-5293-4596-bf3a-3799d44cf7d3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:18.501719 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:18.528903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87ef7-e817-48f7-a032-fc815072f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:18.529543 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87ef7-e817-48f7-a032-fc815072f282 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.529823 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87ef7-e817-48f7-a032-fc815072f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.530093 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87ef7-e817-48f7-a032-fc815072f282 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.530781 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a87ef7-e817-48f7-a032-fc815072f282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:18.532688 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a87ef7-e817-48f7-a032-fc815072f282 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:18.556169 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1442/2883] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:18 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:46:18.557449 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd5c7a-09b0-4945-80f4-a1c0115166d7 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:18.568563 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd5c7a-09b0-4945-80f4-a1c0115166d7 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:18.573240 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2dc43-251f-4b87-b4e1-c13c5970a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:18.573879 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2dc43-251f-4b87-b4e1-c13c5970a786 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.574160 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2dc43-251f-4b87-b4e1-c13c5970a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.574437 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2dc43-251f-4b87-b4e1-c13c5970a786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.575131 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2dc43-251f-4b87-b4e1-c13c5970a786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:18.576721 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2dc43-251f-4b87-b4e1-c13c5970a786 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:18.586799 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1442/2884] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:18.590799 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87ef7-e817-48f7-a032-fc815072f282 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:18.600953 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87ef7-e817-48f7-a032-fc815072f282 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:18.605642 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5bea8-c098-4005-acf5-4fe607acfc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:18.606231 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5bea8-c098-4005-acf5-4fe607acfc32 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.606505 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5bea8-c098-4005-acf5-4fe607acfc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.606774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5bea8-c098-4005-acf5-4fe607acfc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.607455 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5bea8-c098-4005-acf5-4fe607acfc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:18.609948 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5bea8-c098-4005-acf5-4fe607acfc32 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:18.620555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1443/2885] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:18.625202 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2dc43-251f-4b87-b4e1-c13c5970a786 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:18.635080 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2dc43-251f-4b87-b4e1-c13c5970a786 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:18.639765 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958619-12c8-4383-a989-bf80b01d9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:18.640415 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958619-12c8-4383-a989-bf80b01d9dce admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.640700 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958619-12c8-4383-a989-bf80b01d9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.640984 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958619-12c8-4383-a989-bf80b01d9dce admin admin] PATH_INFO: `/v3/projects/3b6e096abe42481e824d0683e12cc1bd/users/302732102ee946ef8f709c3731472aa3/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.652868 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:18.656306 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958619-12c8-4383-a989-bf80b01d9dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6e096abe42481e824d0683e12cc1bd, user_id=302732102ee946ef8f709c3731472aa3, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:18.659154 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958619-12c8-4383-a989-bf80b01d9dce admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:18.672880 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1443/2886] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:18 2022] PUT /identity/v3/projects/3b6e096abe42481e824d0683e12cc1bd/users/302732102ee946ef8f709c3731472aa3/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:18.683092 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b6318-59ce-4bd5-b729-bb484db885e1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.683376 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b6318-59ce-4bd5-b729-bb484db885e1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.683649 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b6318-59ce-4bd5-b729-bb484db885e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.710695 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e04b6318-59ce-4bd5-b729-bb484db885e1 None None] MFA Rules not processed for user `302732102ee946ef8f709c3731472aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:18.711865 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e04b6318-59ce-4bd5-b729-bb484db885e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:18.774463 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1444/2887] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:18.786756 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958619-12c8-4383-a989-bf80b01d9dce admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:18.788409 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-fa958619-12c8-4383-a989-bf80b01d9dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:18.851911 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958619-12c8-4383-a989-bf80b01d9dce admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:18.855529 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c9395-10a8-4c92-931d-b978ebc17f85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2ef9088a9941ddb4b163f282a1f7d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:18.856137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c9395-10a8-4c92-931d-b978ebc17f85 service glance] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:18.856418 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c9395-10a8-4c92-931d-b978ebc17f85 service glance] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:18.856692 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c9395-10a8-4c92-931d-b978ebc17f85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:18.866120 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c9395-10a8-4c92-931d-b978ebc17f85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:18.867534 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c9395-10a8-4c92-931d-b978ebc17f85 service glance] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:18.876494 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1444/2888] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 02:46:28.771510 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=51,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:28.872353 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:39.490434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b6318-59ce-4bd5-b729-bb484db885e1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:39.551191 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b6318-59ce-4bd5-b729-bb484db885e1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:39.555555 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:39.556190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:39.556464 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:39.556732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] PATH_INFO: `/v3/users/302732102ee946ef8f709c3731472aa3` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:39.557891 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302732102ee946ef8f709c3731472aa3)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:39.559804 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:39.604579 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302732102ee946ef8f709c3731472aa3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:39.612520 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302732102ee946ef8f709c3731472aa3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:39.619545 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302732102ee946ef8f709c3731472aa3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:39.620442 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302732102ee946ef8f709c3731472aa3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:39.621200 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302732102ee946ef8f709c3731472aa3'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:39.639481 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1445/2889] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:39 2022] DELETE /identity/v3/users/302732102ee946ef8f709c3731472aa3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:39.643958 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a9cfa-a67b-4ab4-a43f-53b3c9717ee2 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:39.644423 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a9cfa-a67b-4ab4-a43f-53b3c9717ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:39.644544 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a9cfa-a67b-4ab4-a43f-53b3c9717ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:39.663448 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-083a9cfa-a67b-4ab4-a43f-53b3c9717ee2 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:39.664644 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-083a9cfa-a67b-4ab4-a43f-53b3c9717ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:39.721176 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1445/2890] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:39.734861 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:39.736919 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:39.792733 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c671f0-e10a-4dee-9c2c-c5ed4bb8e4a3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:39.796309 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530a488-7c0e-476c-8fb5-456db8eedb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:39.796911 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530a488-7c0e-476c-8fb5-456db8eedb1f service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:39.797188 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530a488-7c0e-476c-8fb5-456db8eedb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:39.797497 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530a488-7c0e-476c-8fb5-456db8eedb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:39.807077 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530a488-7c0e-476c-8fb5-456db8eedb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:39.808428 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530a488-7c0e-476c-8fb5-456db8eedb1f service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:39.817697 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1446/2891] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:40.083008 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a9cfa-a67b-4ab4-a43f-53b3c9717ee2 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:40.084419 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-083a9cfa-a67b-4ab4-a43f-53b3c9717ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:40.097129 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a9cfa-a67b-4ab4-a43f-53b3c9717ee2 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:40.101822 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:40.102468 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.102757 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.103019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] PATH_INFO: `/v3/projects/3b6e096abe42481e824d0683e12cc1bd` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.104171 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6e096abe42481e824d0683e12cc1bd)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:40.106094 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:40.152833 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6e096abe42481e824d0683e12cc1bd', 'request_id': 'req-5c24ad4a-4cda-466d-8821-383af082c014'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:40.160540 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6e096abe42481e824d0683e12cc1bd', 'request_id': 'req-5c24ad4a-4cda-466d-8821-383af082c014'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:40.166209 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6e096abe42481e824d0683e12cc1bd', 'request_id': 'req-5c24ad4a-4cda-466d-8821-383af082c014'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:40.176860 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] The token cache is being invalidate because project 3b6e096abe42481e824d0683e12cc1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:40.177137 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:40.177779 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-5c24ad4a-4cda-466d-8821-383af082c014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:40.179263 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1446/2892] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:40 2022] DELETE /identity/v3/projects/3b6e096abe42481e824d0683e12cc1bd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:40.184146 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4ef2-31c8-4063-8d9f-8e78791c3b54 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.184453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4ef2-31c8-4063-8d9f-8e78791c3b54 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.184749 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4ef2-31c8-4063-8d9f-8e78791c3b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.203776 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-06ef4ef2-31c8-4063-8d9f-8e78791c3b54 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:40.205508 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-06ef4ef2-31c8-4063-8d9f-8e78791c3b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:40.222614 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:40.265789 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1447/2893] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:40.274108 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24493300-6bcf-4852-b565-c97ff79168fb None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.274395 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24493300-6bcf-4852-b565-c97ff79168fb None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.274670 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24493300-6bcf-4852-b565-c97ff79168fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.294592 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-24493300-6bcf-4852-b565-c97ff79168fb None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:40.295790 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-24493300-6bcf-4852-b565-c97ff79168fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:40.303682 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1447/2894] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 02:46:40.307947 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4ef2-31c8-4063-8d9f-8e78791c3b54 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:40.317453 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4ef2-31c8-4063-8d9f-8e78791c3b54 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:40.322114 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531ea02-3cb4-4096-97b5-f0d1ed604cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:40.322711 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531ea02-3cb4-4096-97b5-f0d1ed604cab admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.322986 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531ea02-3cb4-4096-97b5-f0d1ed604cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.323253 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531ea02-3cb4-4096-97b5-f0d1ed604cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.323932 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531ea02-3cb4-4096-97b5-f0d1ed604cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 02:46:40.324732 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531ea02-3cb4-4096-97b5-f0d1ed604cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:40.326407 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531ea02-3cb4-4096-97b5-f0d1ed604cab admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:40.338343 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1448/2895] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Aug 4 02:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 02:46:40.342486 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24493300-6bcf-4852-b565-c97ff79168fb None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:40.351957 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24493300-6bcf-4852-b565-c97ff79168fb None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:40.356485 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772fe17-8715-468a-a109-a967445dfe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:40.357071 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772fe17-8715-468a-a109-a967445dfe21 admin admin] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.357371 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772fe17-8715-468a-a109-a967445dfe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.357649 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772fe17-8715-468a-a109-a967445dfe21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.358336 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772fe17-8715-468a-a109-a967445dfe21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:40.360211 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772fe17-8715-468a-a109-a967445dfe21 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:40.387637 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1448/2896] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Aug 4 02:46:40 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 02:46:40.391808 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531ea02-3cb4-4096-97b5-f0d1ed604cab admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:40.402983 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531ea02-3cb4-4096-97b5-f0d1ed604cab admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:40.457746 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8e9a3-7332-4472-8d92-bbb37f5b52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:40.458361 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8e9a3-7332-4472-8d92-bbb37f5b52d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.458632 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8e9a3-7332-4472-8d92-bbb37f5b52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.458906 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8e9a3-7332-4472-8d92-bbb37f5b52d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.459560 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8e9a3-7332-4472-8d92-bbb37f5b52d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:40.461482 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8e9a3-7332-4472-8d92-bbb37f5b52d6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:40.482150 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1449/2897] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Aug 4 02:46:40 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 02:46:40.486478 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772fe17-8715-468a-a109-a967445dfe21 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:40.496819 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772fe17-8715-468a-a109-a967445dfe21 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:40.501905 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d035d50-7727-4f96-af89-c97d1783fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:40.502500 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d035d50-7727-4f96-af89-c97d1783fb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.502773 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d035d50-7727-4f96-af89-c97d1783fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.503041 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d035d50-7727-4f96-af89-c97d1783fb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.503717 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d035d50-7727-4f96-af89-c97d1783fb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:40.505287 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d035d50-7727-4f96-af89-c97d1783fb09 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:40.514981 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1449/2898] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:40.519328 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8e9a3-7332-4472-8d92-bbb37f5b52d6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:40.529648 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8e9a3-7332-4472-8d92-bbb37f5b52d6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:40.534321 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fef2b-300d-4f91-a200-7453efe19a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:40.534960 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fef2b-300d-4f91-a200-7453efe19a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.535238 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fef2b-300d-4f91-a200-7453efe19a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.535509 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fef2b-300d-4f91-a200-7453efe19a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.536254 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fef2b-300d-4f91-a200-7453efe19a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:40.537908 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fef2b-300d-4f91-a200-7453efe19a4a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:40.549638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1450/2899] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Aug 4 02:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 02:46:40.555422 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d035d50-7727-4f96-af89-c97d1783fb09 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:40.569519 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d035d50-7727-4f96-af89-c97d1783fb09 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:40.575852 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab301bcc-5134-45b8-94de-47639296cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:40.576616 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab301bcc-5134-45b8-94de-47639296cd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.576841 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab301bcc-5134-45b8-94de-47639296cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.577112 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab301bcc-5134-45b8-94de-47639296cd05 admin admin] PATH_INFO: `/v3/projects/6ba4f60261a24635ac25c000b19e162f/users/f4035163bbef493eaaa921baf4096f27/roles/2fcd0ee644864d67833017de80ba1627` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.593620 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab301bcc-5134-45b8-94de-47639296cd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba4f60261a24635ac25c000b19e162f, user_id=f4035163bbef493eaaa921baf4096f27, role_id=2fcd0ee644864d67833017de80ba1627)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:40.596270 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab301bcc-5134-45b8-94de-47639296cd05 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:40.615940 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1450/2900] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Aug 4 02:46:40 2022] PUT /identity/v3/projects/6ba4f60261a24635ac25c000b19e162f/users/f4035163bbef493eaaa921baf4096f27/roles/2fcd0ee644864d67833017de80ba1627 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:40.626831 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c1985-4f1a-4caf-aa00-57189e0af212 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.627137 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c1985-4f1a-4caf-aa00-57189e0af212 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.627434 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c1985-4f1a-4caf-aa00-57189e0af212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.654778 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-801c1985-4f1a-4caf-aa00-57189e0af212 None None] MFA Rules not processed for user `f4035163bbef493eaaa921baf4096f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:40.655971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-801c1985-4f1a-4caf-aa00-57189e0af212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:40.718283 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1451/2901] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:40.728811 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab301bcc-5134-45b8-94de-47639296cd05 admin admin] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:40.730509 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-ab301bcc-5134-45b8-94de-47639296cd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:40.752457 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:40.788399 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab301bcc-5134-45b8-94de-47639296cd05 admin admin] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:40.791974 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04634ed-b616-46cd-b88b-52f387425c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7b8eac1856c4e7f86fe1dea9f752719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:40.792580 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04634ed-b616-46cd-b88b-52f387425c39 service cinder] REQUEST_METHOD: `GET` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:40.792861 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04634ed-b616-46cd-b88b-52f387425c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:40.793132 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04634ed-b616-46cd-b88b-52f387425c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:40.801875 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04634ed-b616-46cd-b88b-52f387425c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:40.803283 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04634ed-b616-46cd-b88b-52f387425c39 service cinder] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:40.812019 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1451/2902] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:50.715352 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:50.806601 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c1985-4f1a-4caf-aa00-57189e0af212 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:50.808051 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=17 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:46:50.868214 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c1985-4f1a-4caf-aa00-57189e0af212 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:50.872621 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:50.873244 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:50.873548 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:50.873819 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] PATH_INFO: `/v3/users/f4035163bbef493eaaa921baf4096f27` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:50.874971 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4035163bbef493eaaa921baf4096f27)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:50.876860 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:50.921613 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4035163bbef493eaaa921baf4096f27'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:50.928764 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4035163bbef493eaaa921baf4096f27'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:50.936022 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4035163bbef493eaaa921baf4096f27'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:50.936638 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4035163bbef493eaaa921baf4096f27'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:50.937259 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4035163bbef493eaaa921baf4096f27'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:50.955862 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1452/2903] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Aug 4 02:46:50 2022] DELETE /identity/v3/users/f4035163bbef493eaaa921baf4096f27 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:46:50.960821 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e555fc6-733d-4ed0-83a7-531f1c6c4a83 None None] REQUEST_METHOD: `POST` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:50.961100 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e555fc6-733d-4ed0-83a7-531f1c6c4a83 None None] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:50.961404 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e555fc6-733d-4ed0-83a7-531f1c6c4a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:50.980890 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.auth.core [None req-3e555fc6-733d-4ed0-83a7-531f1c6c4a83 None None] MFA Rules not processed for user `525c51ec9f124dbfa5960c298384d18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80480) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 02:46:50.982119 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3e555fc6-733d-4ed0-83a7-531f1c6c4a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:51.039152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1452/2904] 10.222.0.69 () {58 vars in 958 bytes} [Thu Aug 4 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 02:46:51.048794 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:51.050190 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:51.106771 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fa8c7-b003-4541-bcd5-61666f1a9d32 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:51.110252 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f40af-8a98-4b8e-a38e-89e2badc9680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd110c27fc9c045ea9a4eb49b4dafe221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:51.111113 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f40af-8a98-4b8e-a38e-89e2badc9680 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:51.111392 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f40af-8a98-4b8e-a38e-89e2badc9680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:51.111657 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f40af-8a98-4b8e-a38e-89e2badc9680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:51.120461 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f40af-8a98-4b8e-a38e-89e2badc9680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:51.121903 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f40af-8a98-4b8e-a38e-89e2badc9680 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:51.131115 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1453/2905] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:46:51.391174 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e555fc6-733d-4ed0-83a7-531f1c6c4a83 None None] Authenticating user token {{(pid=80480) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:46:51.392598 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.fernet_utils [None req-3e555fc6-733d-4ed0-83a7-531f1c6c4a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80480) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:46:51.405593 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e555fc6-733d-4ed0-83a7-531f1c6c4a83 None None] Validating token access rules against request {{(pid=80480) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:46:51.411089 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525c51ec9f124dbfa5960c298384d18f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfeabf1f8bfc459e9c6e85a4b8e64db7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80480) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:46:51.416417 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:46:51.416712 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:46:51.417059 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] PATH_INFO: `/v3/projects/6ba4f60261a24635ac25c000b19e162f` {{(pid=80480) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:46:51.418227 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba4f60261a24635ac25c000b19e162f)` {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:46:51.420164 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] RBAC: Authorization granted {{(pid=80480) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:46:51.467921 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba4f60261a24635ac25c000b19e162f', 'request_id': 'req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:51.474985 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba4f60261a24635ac25c000b19e162f', 'request_id': 'req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:51.480456 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba4f60261a24635ac25c000b19e162f', 'request_id': 'req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62'} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:51.492639 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] The token cache is being invalidate because project 6ba4f60261a24635ac25c000b19e162f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80480) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 02:46:51.492963 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:51.493632 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG keystone.notifications [None req-1328d0ff-1d13-4653-8bee-ea3ffb0a4e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80480) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 02:46:51.495152 dv-cinder-733062-32-smb devstack@keystone.service[80480]: [pid: 80480|app: 0|req: 1453/2906] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Aug 4 02:46:51 2022] DELETE /identity/v3/projects/6ba4f60261a24635ac25c000b19e162f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 02:47:01.127098 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:47:01.489374 dv-cinder-733062-32-smb devstack@keystone.service[80480]: DEBUG dbcounter [-] [80480] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80480) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 02:49:06.995660 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f40af-8a98-4b8e-a38e-89e2badc9680 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 02:49:06.997047 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9f2f40af-8a98-4b8e-a38e-89e2badc9680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:49:07.064633 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f40af-8a98-4b8e-a38e-89e2badc9680 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 02:49:07.122475 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab21c-6310-4dce-bf2f-026911b1b5a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '234cbff2a729458a8dad108baaba6c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf5e1d00db34b0eacd1a5d39c76fbbc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 02:49:07.123083 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab21c-6310-4dce-bf2f-026911b1b5a3 service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 02:49:07.123367 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab21c-6310-4dce-bf2f-026911b1b5a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 02:49:07.123644 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab21c-6310-4dce-bf2f-026911b1b5a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 02:49:07.125418 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7ecab21c-6310-4dce-bf2f-026911b1b5a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 02:49:07.136526 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab21c-6310-4dce-bf2f-026911b1b5a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 02:49:07.138122 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab21c-6310-4dce-bf2f-026911b1b5a3 service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 02:49:07.147990 dv-cinder-733062-32-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1454/2907] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Aug 4 02:49:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 02:49:17.143774 dv-cinder-733062-32-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=58 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}